Apr 08 17:32:38 devstack cinder-volume[72755]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 17:32:38 devstack cinder-volume[72755]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 17:32:38 devstack cinder-volume[72755]: we strongly recommend against using it for new projects. Apr 08 17:32:38 devstack cinder-volume[72755]: If you are already using Eventlet, we recommend migrating to a different Apr 08 17:32:38 devstack cinder-volume[72755]: framework. For more detail see Apr 08 17:32:38 devstack cinder-volume[72755]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 17:32:38 devstack cinder-volume[72755]: import eventlet # noqa Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:32:40 devstack cinder-volume[72755]: INFO dbcounter [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Registered counter for database cinder Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG dbcounter [-] [72755] Writer thread running {{(pid=72755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:32:40 devstack cinder-volume[72755]: INFO cinder.rpc [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 17:32:40 devstack cinder-volume[72755]: INFO cinder.rpc [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:32:40 devstack cinder-volume[72755]: INFO cinder.volume.manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Determined volume DB was empty at startup. Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG cinder.volume.manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72755) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 17:32:40 devstack cinder-volume[72755]: INFO cinder.volume.manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 08 17:32:40 devstack cinder-volume[72755]: WARNING stevedore.named [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 17:32:40 devstack cinder-volume[72755]: WARNING castellan.key_manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:32:40 devstack cinder-volume[72755]: WARNING cinder.keymgr.conf_key_mgr [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG cinder.volume.drivers.lvm [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72755) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 08 17:32:40 devstack cinder-volume[72755]: DEBUG oslo_concurrency.processutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_concurrency.processutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] CMD "cinder-rtstool verify" returned: 0 in 0.257s {{(pid=72755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:32:41 devstack cinder-volume[72755]: INFO cinder.rpc [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 08 17:32:41 devstack cinder-volume[72755]: INFO cinder.rpc [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 08 17:32:41 devstack cinder-volume[72755]: WARNING stevedore.named [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 17:32:41 devstack cinder-volume[72755]: WARNING castellan.key_manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:32:41 devstack cinder-volume[72755]: INFO cinder.volume.manager [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_db.sqlalchemy.engines [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:32:41 devstack cinder-volume[72755]: INFO oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Starting 1 workers Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Started child 72858 {{(pid=72755) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Full set of CONF: {{(pid=72755) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] ******************************************************************************** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Configuration options gathered from: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] ================================================================================ {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] allow_availability_zone_fallback = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] allow_compression_on_image_upload = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72858]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] allowed_direct_url_schemes = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] api_rate_limit = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] auth_strategy = keystone {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] az_cache_duration = 3600 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_availability_zone = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_host = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_stats_polling_interval = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backup_api_class = cinder.backup.api.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backup_name_template = backup-%s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backup_use_same_host = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backup_use_temp_snapshot = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] chap_password = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] chap_username = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_internal_tenant_project_id = 951a179555034e7fb8a087dd4fa8f5da {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_internal_tenant_user_id = e907d66f240649c182029c6464c41571 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cloned_volume_same_az = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cluster = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] compression_format = gzip {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] compute_api_class = cinder.compute.nova.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] config_dir = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] config_source = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] control_exchange = openstack {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] debug = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] default_availability_zone = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] default_group_type = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] default_volume_type = lvmdriver-1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] disk_geometry = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_client_cert = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_client_cert_key = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_data_namespace = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_ssl_cert_path = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_ssl_cert_verify = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] driver_use_ssl = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] enable_force_upload = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] enable_new_services = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] enable_unsupported_driver = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] enforce_multipath_for_image_xfer = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] filter_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_api_insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_api_ssl_compression = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_ca_certificates_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_catalog_info = image:glance:publicURL {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_num_retries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance_request_timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] goodness_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] graceful_shutdown_timeout = 5 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] group_api_class = cinder.group.api.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] host = devstack {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_compress_on_upload = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_conversion_address_space_limit = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_conversion_cpu_limit = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_conversion_disable = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_upload_use_cinder_backend = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_upload_use_internal_tenant = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_volume_cache_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_volume_cache_max_count = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] image_volume_cache_max_size_gb = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] init_host_max_objects_retrieval = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] instance_format = [instance: %(uuid)s] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iscsi_target_flags = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iscsi_write_cache = on {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iser_helper = tgtadm {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iser_ip_address = 192.168.122.132 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iser_port = 3260 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_color = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_config_append = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_dir = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_options = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_rotate_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_rotate_interval_type = days {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] log_rotation_type = none {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] max_age = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] max_logfile_count = 30 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] max_logfile_size_mb = 200 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] max_over_subscription_ratio = 20.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] message_reap_interval = 86400 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] message_ttl = 2592000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] migration_create_volume_timeout_secs = 300 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] monkey_patch = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] monkey_patch_modules = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] my_ip = 192.168.122.132 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] no_snapshot_gb_quota = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] num_iser_scan_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] num_shell_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] num_volume_device_scan_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] nvmeof_conn_info_version = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] nvmet_ns_id = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72858]: INFO cinder.volume.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] nvmet_port_id = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_max_limit = 1000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_ext_list = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_listen_port = 8776 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_use_ssl = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] osapi_volume_workers = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] per_volume_size_limit = -1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] periodic_fuzzy_delay = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] periodic_interval = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] public_endpoint = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] publish_errors = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_backup_gigabytes = 1000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_backups = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_gigabytes = 1000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_groups = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_snapshots = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] quota_volumes = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] rate_limit_burst = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] rate_limit_except_level = CRITICAL {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] rate_limit_interval = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] reinit_driver_count = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] replication_device = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] report_discard_supported = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] report_interval = 120 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] reservation_clean_interval = 86400 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] reservation_expire = 86400 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] reserved_image_namespaces = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] reserved_percentage = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] rpc_response_timeout = 120 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] run_external_periodic_tasks = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] scst_target_driver = iscsi {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] scst_target_iqn_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_down_time = 720 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] shell_completion = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] snapshot_name_template = snapshot-%s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] snapshot_same_host = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] split_loggers = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] state_path = /opt/stack/data/cinder {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] storage_availability_zone = nova {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] storage_protocol = iSCSI {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] syslog_log_facility = LOG_USER {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_helper = lioadm {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_ip_address = 192.168.122.132 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_port = 3260 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_protocol = iscsi {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] target_secondary_ip_addresses = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] trace_flags = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] transport_url = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] until_refresh = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_chap_auth = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_default_quota_class = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_journal = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_json = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_multipath_for_image_xfer = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_stderr = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] use_syslog = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] verify_glance_signatures = enabled {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_api_class = cinder.volume.api.API {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_backend_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_clear = zero {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_clear_ionice = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_clear_size = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_copy_bps_limit = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_dd_blocksize = 1M {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_name_template = volume-%s {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_service_inithost_offload = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volume_usage_audit_period = month {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] zoning_mode = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_concurrency.disable_process_locking = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.admin_password = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.admin_token = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.admin_user = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_port = 35357 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_protocol = https {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_section = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_type = password {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_uri = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.auth_version = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.cache = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.identity_uri = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.include_service_catalog = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.interface = public {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_password = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcache_username = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.region_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.service_type = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.backend = dogpile.cache.null {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.backend_argument = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.backend_expiration_time = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.config_prefix = cache.oslo {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.debug_cache_backend = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.enable_retry_client = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.enable_socket_keepalive = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.enforce_fips_mode = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.expiration_time = 600 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.hashclient_retry_attempts = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_dead_retry = 300 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_pool_maxsize = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_sasl_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.password = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.proxies = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.redis_db = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.redis_server = localhost:6379 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.retry_attempts = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.retry_delay = 0.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.socket_keepalive_count = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.socket_keepalive_idle = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.socket_keepalive_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.socket_timeout = 1.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.tls_allowed_ciphers = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.tls_cafile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.tls_certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.tls_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.tls_keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cache.username = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] coordination.backend_url = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.asyncio_connection = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.asyncio_slave_connection = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.backend = sqlalchemy {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.connection = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.connection_debug = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.connection_parameters = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.connection_recycle_time = 3600 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.connection_trace = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.db_inc_retry_interval = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.db_max_retries = 20 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.db_max_retry_interval = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.db_retry_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.max_overflow = 50 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.max_pool_size = 5 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.max_retries = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.mysql_wsrep_sync_wait = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.pool_timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.retry_interval = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.slave_connection = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.sqlite_synchronous = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.synchronous_reader = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] database.use_db_reconnect = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.connection_string = messaging:// {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.es_doc_type = notification {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.es_scroll_size = 10000 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.es_scroll_time = 2m {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.filter_error_trace = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.hmac_keys = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.sentinel_service_name = mymaster {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.socket_timeout = 0.1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.trace_requests = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler.trace_sqlalchemy = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler_jaeger.process_tags = {} {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler_jaeger.service_name_prefix = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] profiler_otlp.service_name_prefix = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.enforce_new_defaults = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: WARNING oslo_config.cfg [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.enforce_scope = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.policy_default_rule = default {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.policy_file = policy.yaml {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.group = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.helper_command = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] privsep_osbrick.user = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.group = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.helper_command = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] cinder_sys_admin.user = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.auth_section = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.auth_type = password {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.cafile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.collect_timing = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.send_service_user_token = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.split_loggers = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] service_user.timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.auth_section = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.auth_type = password {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.collect_timing = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.region_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.split_loggers = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] glance.timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.backend_availability_zone = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.chap_password = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.chap_username = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.disk_geometry = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_client_cert = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_client_cert_key = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_data_namespace = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.driver_use_ssl = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.extra_capabilities = {} {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.filter_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.goodness_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iscsi_target_flags = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iscsi_write_cache = on {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iser_helper = tgtadm {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iser_port = 3260 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.lvm_share_target = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.lvm_type = auto {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.num_shell_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.replication_device = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.report_discard_supported = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.reserved_percentage = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_helper = tgtadm {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_port = 3260 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_protocol = iscsi {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.trace_flags = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.unique_fqdn_network = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.use_chap_auth = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_backend_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_clear = zero {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_clear_ionice = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_clear_size = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_reports.file_event_handler = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_reports.log_dir = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.backend_host = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.chap_password = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.chap_username = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.disk_geometry = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_client_cert = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.extra_capabilities = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.filter_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.goodness_function = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iser_helper = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iser_ip_address = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iser_port = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.lvm_share_target = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.lvm_type = auto {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.num_shell_tries = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.replication_device = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.report_discard_supported = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.reserved_percentage = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.scst_target_driver = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.storage_protocol = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_helper = lioadm {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_ip_address = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_port = 3260 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.trace_flags = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.use_chap_auth = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_clear = zero {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_clear_size = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] lvmdriver-1.volumes_dir = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack sudo[72863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack sudo[72863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_notifications.driver = [] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_notifications.retry = -1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] key_manager.fixed_key = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.barbican_api_version = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.barbican_endpoint = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.barbican_endpoint_type = public {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.barbican_region_name = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.cafile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.collect_timing = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.number_of_retries = 60 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.retry_delay = 1 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.send_service_user_token = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.split_loggers = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.verify_ssl = True {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican.verify_ssl_path = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.auth_section = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.auth_type = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.cafile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.certfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.collect_timing = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.insecure = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.keyfile = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.split_loggers = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] barbican_service_user.timeout = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.approle_role_id = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.approle_secret_id = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.kv_mountpoint = secret {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.kv_path = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.kv_version = 2 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.namespace = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.root_token_id = **** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.ssl_ca_crt_file = None {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.timeout = 60.0 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.use_ssl = False {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:32:41 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] ******************************************************************************** {{(pid=72755) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 17:32:41 devstack sudo[72863]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:41 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:41 devstack sudo[72875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:41 devstack sudo[72875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:42 devstack sudo[72875]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:42 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.495s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:42 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:32:42 devstack cinder-volume[72858]: INFO cinder.brick.local_dev.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 08 17:32:42 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:42 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:42 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:42 devstack sudo[72987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:42 devstack sudo[72987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:43 devstack sudo[72987]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:43 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:43 devstack cinder-volume[72858]: DEBUG cinder.brick.local_dev.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72858) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 08 17:32:43 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:43 devstack sudo[73210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:43 devstack sudo[73210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:44 devstack sudo[73210]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.028s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:44 devstack sudo[73471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:44 devstack sudo[73471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:44 devstack sudo[73471]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.548s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:44 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:44 devstack sudo[73566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 08 17:32:44 devstack sudo[73566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:45 devstack sudo[73566]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:45 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.502s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:45 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:45 devstack sudo[73601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:45 devstack sudo[73601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:45 devstack sudo[73601]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:45 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:45 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:45 devstack sudo[73606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:45 devstack sudo[73606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:46 devstack sudo[73606]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:46 devstack sudo[73614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:46 devstack sudo[73614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:46 devstack sudo[73614]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:46 devstack sudo[73617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:46 devstack sudo[73617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:46 devstack sudo[73617]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:46 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:47 devstack sudo[73623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:47 devstack sudo[73623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:47 devstack sudo[73623]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:47 devstack cinder-volume[72858]: INFO cinder.volume.drivers.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:47 devstack sudo[73627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:47 devstack sudo[73627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:47 devstack sudo[73627]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:32:47 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:48 devstack sudo[73704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:48 devstack sudo[73704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:48 devstack sudo[73704]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:48 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:48 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:48 devstack sudo[73752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:48 devstack sudo[73752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:48 devstack sudo[73752]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:48 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:48 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:48 devstack sudo[73787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:48 devstack sudo[73787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:49 devstack sudo[73787]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:49 devstack sudo[73894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:49 devstack sudo[73894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:49 devstack sudo[73894]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:49 devstack cinder-volume[72858]: INFO cinder.volume.driver [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Driver hasn't implemented _init_vendor_properties() Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG cinder.volume.driver [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72858) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG oslo_db.sqlalchemy.engines [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG dbcounter [-] [72858] Writer thread running {{(pid=72858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG cinder.db.sqlalchemy.api [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Building query based on filter {{(pid=72858) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG cinder.image.image_utils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72858) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 17:32:49 devstack cinder-volume[72858]: INFO cinder.keymgr.migration [None req-4acfd421-aeef-4b2b-ab28-0a8eacd0e7c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:32:49 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:49 devstack sudo[73902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:49 devstack sudo[73902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:50 devstack sudo[73902]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:50 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:50 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:50 devstack sudo[73905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:50 devstack sudo[73905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:50 devstack sudo[73905]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:50 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:50 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:50 devstack sudo[73908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:50 devstack sudo[73908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:51 devstack sudo[73908]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:51 devstack sudo[73913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:51 devstack sudo[73913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:51 devstack cinder-volume[72755]: DEBUG dbcounter [-] [72755] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:32:51 devstack sudo[73913]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG cinder.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Notifying Schedulers of capabilities ... {{(pid=72858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:32:51 devstack cinder-volume[72858]: INFO cinder.volume.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Driver initialization completed successfully. Apr 08 17:32:51 devstack cinder-volume[72858]: INFO cinder.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Initiating service 2 cleanup Apr 08 17:32:51 devstack cinder-volume[72858]: INFO cinder.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Service 2 cleanup completed. Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG cinder.service [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Creating RPC server for service cinder-volume {{(pid=72858) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG cinder.service [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72858) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 17:32:51 devstack cinder-volume[72858]: INFO cinder.volume.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:32:51 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:51 devstack sudo[73921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:32:51 devstack sudo[73921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:52 devstack sudo[73921]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:52 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:52 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:52 devstack sudo[73927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:52 devstack sudo[73927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:52 devstack sudo[73927]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:52 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:52 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:52 devstack sudo[73930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:32:52 devstack sudo[73930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:53 devstack sudo[73930]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:53 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:53 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:32:53 devstack sudo[73987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:32:53 devstack sudo[73987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:32:53 devstack sudo[73987]: pam_unix(sudo:session): session closed for user root Apr 08 17:32:53 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:32:53 devstack cinder-volume[72858]: INFO cinder.volume.manager [None req-f1925946-5b48-4bc2-a4d3-6ffeef094984 None None] Driver post RPC initialization completed successfully. Apr 08 17:33:03 devstack cinder-volume[72858]: DEBUG dbcounter [-] [72858] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:33:03 devstack cinder-volume[72858]: DEBUG dbcounter [-] [72858] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:34:05 devstack cinder-volume[72858]: DEBUG oslo_service.periodic_task [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72858) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:34:05 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:34:05 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:34:05 devstack sudo[78746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:34:05 devstack sudo[78746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:34:06 devstack sudo[78746]: pam_unix(sudo:session): session closed for user root Apr 08 17:34:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:34:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:34:06 devstack sudo[78758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:34:06 devstack sudo[78758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:34:06 devstack sudo[78758]: pam_unix(sudo:session): session closed for user root Apr 08 17:34:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:34:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:34:06 devstack sudo[78761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:34:06 devstack sudo[78761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:34:07 devstack sudo[78761]: pam_unix(sudo:session): session closed for user root Apr 08 17:34:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:34:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:34:07 devstack sudo[78769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:34:07 devstack sudo[78769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:34:07 devstack sudo[78769]: pam_unix(sudo:session): session closed for user root Apr 08 17:34:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:34:07 devstack cinder-volume[72858]: DEBUG cinder.manager [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Notifying Schedulers of capabilities ... {{(pid=72858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:35:03 devstack cinder-volume[72858]: DEBUG dbcounter [-] [72858] Writing DB stats cinder:SELECT=1 {{(pid=72858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:35:03 devstack cinder-volume[72858]: DEBUG dbcounter [-] [72858] Writing DB stats cinder:UPDATE=1 {{(pid=72858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:35:05 devstack cinder-volume[72858]: DEBUG oslo_service.periodic_task [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72858) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:35:05 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:35:05 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:35:05 devstack sudo[80517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:35:05 devstack sudo[80517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:35:06 devstack sudo[80517]: pam_unix(sudo:session): session closed for user root Apr 08 17:35:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:35:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:35:06 devstack sudo[80546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:35:06 devstack sudo[80546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:35:06 devstack sudo[80546]: pam_unix(sudo:session): session closed for user root Apr 08 17:35:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:35:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:35:06 devstack sudo[80575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:35:06 devstack sudo[80575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:35:07 devstack sudo[80575]: pam_unix(sudo:session): session closed for user root Apr 08 17:35:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:35:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:35:07 devstack sudo[80589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:35:07 devstack sudo[80589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:35:07 devstack sudo[80589]: pam_unix(sudo:session): session closed for user root Apr 08 17:35:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:35:07 devstack cinder-volume[72858]: DEBUG cinder.manager [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Notifying Schedulers of capabilities ... {{(pid=72858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:36:05 devstack cinder-volume[72858]: DEBUG oslo_service.periodic_task [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72858) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:36:05 devstack cinder-volume[72858]: DEBUG cinder.volume.drivers.lvm [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Updating volume stats {{(pid=72858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 08 17:36:05 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:05 devstack sudo[81795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 08 17:36:05 devstack sudo[81795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:06 devstack sudo[81795]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:06 devstack sudo[81800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:36:06 devstack sudo[81800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:06 devstack sudo[81800]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:06 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:06 devstack sudo[81814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 08 17:36:06 devstack sudo[81814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:07 devstack sudo[81814]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:07 devstack sudo[81817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 08 17:36:07 devstack sudo[81817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:07 devstack sudo[81817]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:07 devstack cinder-volume[72858]: DEBUG oslo_concurrency.processutils [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:07 devstack cinder-volume[72858]: DEBUG cinder.manager [None req-7b44cbd7-598b-431b-a1c1-8a23a7775460 None None] Notifying Schedulers of capabilities ... {{(pid=72858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:36:13 devstack cinder-volume[72755]: INFO oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Caught SIGTERM, stopping children Apr 08 17:36:13 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Acquiring lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:13 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Acquired lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:13 devstack cinder-volume[72755]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Releasing lock "singleton_lock" {{(pid=72755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:13 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Stop services. {{(pid=72755) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 08 17:36:13 devstack cinder-volume[72755]: DEBUG oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Killing children. {{(pid=72755) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 08 17:36:13 devstack cinder-volume[72755]: INFO oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Waiting on 1 children to exit Apr 08 17:36:16 devstack cinder-volume[72858]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Acquiring lock "singleton_lock" {{(pid=72858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:16 devstack cinder-volume[72858]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Acquired lock "singleton_lock" {{(pid=72858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:16 devstack cinder-volume[72858]: DEBUG oslo_concurrency.lockutils [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Releasing lock "singleton_lock" {{(pid=72858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:16 devstack cinder-volume[72858]: WARNING amqp [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 17:36:16 devstack cinder-volume[72858]: WARNING amqp [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 17:36:16 devstack cinder-volume[72755]: INFO oslo_service.backend._eventlet.service [None req-9c0644b0-0ef2-4b08-9539-911131ced853 None None] Child 72858 exited with status 0 Apr 08 17:36:17 devstack cinder-volume[82111]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 17:36:17 devstack cinder-volume[82111]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 17:36:17 devstack cinder-volume[82111]: we strongly recommend against using it for new projects. Apr 08 17:36:17 devstack cinder-volume[82111]: If you are already using Eventlet, we recommend migrating to a different Apr 08 17:36:17 devstack cinder-volume[82111]: framework. For more detail see Apr 08 17:36:17 devstack cinder-volume[82111]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 17:36:17 devstack cinder-volume[82111]: import eventlet # noqa Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:19 devstack cinder-volume[82111]: INFO dbcounter [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Registered counter for database cinder Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG oslo_db.sqlalchemy.engines [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG dbcounter [-] [82111] Writer thread running {{(pid=82111) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:36:19 devstack cinder-volume[82111]: INFO cinder.rpc [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 17:36:19 devstack cinder-volume[82111]: INFO cinder.rpc [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG oslo_db.sqlalchemy.engines [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:19 devstack cinder-volume[82111]: INFO cinder.volume.manager [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Determined volume DB was empty at startup. Apr 08 17:36:19 devstack cinder-volume[82111]: DEBUG cinder.volume.manager [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82111) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 17:36:19 devstack cinder-volume[82111]: INFO cinder.volume.manager [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 08 17:36:19 devstack cinder-volume[82111]: WARNING stevedore.named [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 17:36:19 devstack cinder-volume[82111]: WARNING castellan.key_manager [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:36:19 devstack cinder-volume[82111]: WARNING cinder.keymgr.conf_key_mgr [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:36:20 devstack cinder-volume[82111]: INFO cinder.volume.manager [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_db.sqlalchemy.engines [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:20 devstack cinder-volume[82111]: INFO oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Starting 1 workers Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Started child 82231 {{(pid=82111) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Full set of CONF: {{(pid=82111) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] ******************************************************************************** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Configuration options gathered from: {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] ================================================================================ {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] allow_availability_zone_fallback = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82231]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] allow_compression_on_image_upload = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] allowed_direct_url_schemes = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] api_rate_limit = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] auth_strategy = keystone {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_availability_zone = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_host = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_stats_polling_interval = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backup_api_class = cinder.backup.api.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backup_name_template = backup-%s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backup_use_same_host = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backup_use_temp_snapshot = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] chap_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] chap_username = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_internal_tenant_project_id = 951a179555034e7fb8a087dd4fa8f5da {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_internal_tenant_user_id = e907d66f240649c182029c6464c41571 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cluster = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] compression_format = gzip {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] compute_api_class = cinder.compute.nova.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] config_dir = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] config_source = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] control_exchange = openstack {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] debug = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] default_availability_zone = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] default_group_type = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] default_volume_type = QuobyteHD {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] disk_geometry = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_client_cert = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_client_cert_key = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_data_namespace = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_ssl_cert_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_ssl_cert_verify = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] driver_use_ssl = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] enable_new_services = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] enable_unsupported_driver = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] enabled_backends = ['QuobyteHD'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] enforce_multipath_for_image_xfer = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] filter_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_api_insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_api_ssl_compression = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_ca_certificates_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_catalog_info = image:glance:publicURL {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_num_retries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance_request_timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] goodness_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] graceful_shutdown_timeout = 5 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] group_api_class = cinder.group.api.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] host = devstack {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_compress_on_upload = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_conversion_address_space_limit = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_conversion_cpu_limit = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_conversion_disable = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_upload_use_cinder_backend = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_upload_use_internal_tenant = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_volume_cache_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_volume_cache_max_count = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] image_volume_cache_max_size_gb = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] init_host_max_objects_retrieval = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] instance_format = [instance: %(uuid)s] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iscsi_target_flags = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iscsi_write_cache = on {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iser_helper = tgtadm {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iser_ip_address = 192.168.122.132 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iser_port = 3260 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_color = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_config_append = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_dir = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_options = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_rotate_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_rotate_interval_type = days {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] log_rotation_type = none {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] max_age = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] max_logfile_count = 30 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] max_logfile_size_mb = 200 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] max_over_subscription_ratio = 20.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] message_reap_interval = 86400 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] message_ttl = 2592000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] migration_create_volume_timeout_secs = 300 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.remotefs [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82231) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] monkey_patch = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] monkey_patch_modules = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] my_ip = 192.168.122.132 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] no_snapshot_gb_quota = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] num_iser_scan_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] num_shell_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] num_volume_device_scan_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] nvmeof_conn_info_version = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] nvmet_ns_id = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] nvmet_port_id = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_max_limit = 1000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_ext_list = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_listen_port = 8776 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_use_ssl = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] osapi_volume_workers = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] per_volume_size_limit = -1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] periodic_fuzzy_delay = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] periodic_interval = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] public_endpoint = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] publish_errors = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_backup_gigabytes = 1000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_backups = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_gigabytes = 1000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_groups = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_snapshots = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] quota_volumes = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] rate_limit_burst = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] rate_limit_except_level = CRITICAL {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] rate_limit_interval = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] reinit_driver_count = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] replication_device = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] report_discard_supported = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] report_interval = 120 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] reservation_clean_interval = 86400 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] reservation_expire = 86400 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] reserved_image_namespaces = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] reserved_percentage = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] rpc_response_timeout = 120 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] run_external_periodic_tasks = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] scst_target_driver = iscsi {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] scst_target_iqn_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_down_time = 720 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] shell_completion = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] snapshot_name_template = snapshot-%s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] split_loggers = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] state_path = /opt/stack/data/cinder {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] storage_availability_zone = nova {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] storage_protocol = iSCSI {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] syslog_log_facility = LOG_USER {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_helper = lioadm {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_ip_address = 192.168.122.132 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_port = 3260 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_protocol = iscsi {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] target_secondary_ip_addresses = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] trace_flags = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] transport_url = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] until_refresh = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_chap_auth = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_default_quota_class = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_journal = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_json = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_multipath_for_image_xfer = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_stderr = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] use_syslog = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] verify_glance_signatures = enabled {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_api_class = cinder.volume.api.API {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_backend_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_clear = zero {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_clear_ionice = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_clear_size = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_copy_bps_limit = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_dd_blocksize = 1M {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_name_template = volume-%s {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_service_inithost_offload = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volume_usage_audit_period = month {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] zoning_mode = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.admin_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.admin_token = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.admin_user = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_port = 35357 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_protocol = https {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_section = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_type = password {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_uri = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.auth_version = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.cache = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.identity_uri = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.include_service_catalog = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.interface = public {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_password = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcache_username = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.region_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.service_type = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.backend = dogpile.cache.null {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.backend_argument = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.backend_expiration_time = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.config_prefix = cache.oslo {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.debug_cache_backend = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.enable_retry_client = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.enable_socket_keepalive = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.enforce_fips_mode = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.expiration_time = 600 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_dead_retry = 300 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_pool_maxsize = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_sasl_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.proxies = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.redis_db = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.redis_server = localhost:6379 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.retry_attempts = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.retry_delay = 0.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.socket_keepalive_count = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.socket_keepalive_idle = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.socket_keepalive_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.socket_timeout = 1.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.tls_allowed_ciphers = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.tls_cafile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.tls_certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.tls_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.tls_keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82231) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cache.username = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: WARNING cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] coordination.backend_url = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: WARNING cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.asyncio_connection = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.asyncio_slave_connection = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.backend = sqlalchemy {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.connection = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.connection_debug = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Running cmd (subprocess): mount.quobyte {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.connection_parameters = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.connection_recycle_time = 3600 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.connection_trace = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.db_inc_retry_interval = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.db_max_retries = 20 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.db_max_retry_interval = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.db_retry_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.max_overflow = 50 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.max_pool_size = 5 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.max_retries = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.pool_timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.retry_interval = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.slave_connection = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.sqlite_synchronous = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.synchronous_reader = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] database.use_db_reconnect = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.connection_string = messaging:// {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.es_doc_type = notification {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.es_scroll_size = 10000 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.es_scroll_time = 2m {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.filter_error_trace = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.hmac_keys = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.sentinel_service_name = mymaster {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.socket_timeout = 0.1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.trace_requests = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler.trace_sqlalchemy = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler_jaeger.process_tags = {} {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] profiler_otlp.service_name_prefix = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: WARNING oslo_config.cfg [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.enforce_scope = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.policy_default_rule = default {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.policy_file = policy.yaml {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.group = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.helper_command = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] privsep_osbrick.user = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.group = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.helper_command = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] cinder_sys_admin.user = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.auth_section = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.auth_type = password {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.cafile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.collect_timing = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.send_service_user_token = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.split_loggers = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] service_user.timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.auth_section = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.auth_type = password {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.collect_timing = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.region_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.split_loggers = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] glance.timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.backend_availability_zone = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.chap_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.chap_username = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.disk_geometry = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_client_cert = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_client_cert_key = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_data_namespace = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.driver_use_ssl = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.extra_capabilities = {} {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.filter_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.goodness_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iscsi_target_flags = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iscsi_write_cache = on {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iser_helper = tgtadm {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iser_port = 3260 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_host = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_login = admin {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_mount_options = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_private_key = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_share_path = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.num_shell_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.quobyte_volume_url = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.replication_device = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.report_discard_supported = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.reserved_percentage = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_helper = tgtadm {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_port = 3260 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_protocol = iscsi {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.trace_flags = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.unique_fqdn_network = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.use_chap_auth = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_backend_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_clear = zero {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_clear_ionice = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_clear_size = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_reports.file_event_handler = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_reports.log_dir = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.backend_availability_zone = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.backend_host = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.chap_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.chap_username = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.chiscsi_conf = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.disk_geometry = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_client_cert = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_data_namespace = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.driver_use_ssl = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.extra_capabilities = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.filter_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.goodness_function = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iser_helper = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iser_ip_address = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iser_port = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.iser_target_prefix = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_host = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_login = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_mount_options = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_password = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_private_key = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_share_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_ssh_port = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.num_shell_tries = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.nvmet_port_id = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.replication_device = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.report_discard_supported = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.reserved_percentage = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.scst_target_driver = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.storage_protocol = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_helper = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_ip_address = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_port = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_prefix = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_protocol = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.trace_flags = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.use_chap_auth = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_clear = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_clear_size = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] QuobyteHD.volumes_dir = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack quobyte-client[82232]: Reading configuration file: /etc/quobyte/client.cfg Apr 08 17:36:20 devstack quobyte-client[82232]: Invalid parameters found, error: missing mount point. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack quobyte-client[82232]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack quobyte-client[82232]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_notifications.driver = [] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] key_manager.fixed_key = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.barbican_api_version = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.barbican_endpoint = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.barbican_endpoint_type = public {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.barbican_region_name = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.cafile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.collect_timing = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.number_of_retries = 60 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.retry_delay = 1 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.send_service_user_token = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.split_loggers = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.verify_ssl = True {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican.verify_ssl_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.auth_section = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.auth_type = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.cafile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.certfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.collect_timing = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.insecure = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.keyfile = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.split_loggers = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] barbican_service_user.timeout = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.approle_role_id = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.approle_secret_id = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.kv_mountpoint = secret {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.kv_path = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.kv_version = 2 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.namespace = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.root_token_id = **** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.ssl_ca_crt_file = None {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.timeout = 60.0 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.use_ssl = False {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:20 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] ******************************************************************************** {{(pid=82111) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:20 devstack cinder-volume[82231]: INFO cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f ... Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 -c /etc/quobyte/client-cinder.cfg {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:20 devstack sudo[82233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 -c /etc/quobyte/client-cinder.cfg Apr 08 17:36:20 devstack sudo[82233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:20 devstack sudo[82233]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.521s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:20 devstack cinder-volume[82231]: INFO cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f succeeded Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.543s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:20 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:20 devstack sudo[82302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:20 devstack sudo[82302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:21 devstack sudo[82302]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.393s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.volume.driver [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Driver hasn't implemented _init_vendor_properties() Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.volume.driver [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_db.sqlalchemy.engines [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG dbcounter [-] [82231] Writer thread running {{(pid=82231) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.db.sqlalchemy.api [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Building query based on filter {{(pid=82231) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.image.image_utils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.keymgr.migration [None req-5280472f-d234-4e58-8dac-ce03e7a3fb2b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:21 devstack sudo[82306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:21 devstack sudo[82306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:21 devstack sudo[82306]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.424s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Notifying Schedulers of capabilities ... {{(pid=82231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Driver initialization completed successfully. Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Initiating service 3 cleanup Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Service 3 cleanup completed. Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.service [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Creating RPC server for service cinder-volume {{(pid=82231) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.service [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82231) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 17:36:21 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:21 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:21 devstack sudo[82335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:21 devstack sudo[82335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:22 devstack sudo[82335]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:22 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.794s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:22 devstack cinder-volume[82231]: INFO cinder.volume.manager [None req-24c8c4cc-7a73-4cfe-a91c-45279bcdf890 None None] Driver post RPC initialization completed successfully. Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG cinder.volume.drivers.quobyte [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82231) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:24 devstack sudo[82378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:24 devstack sudo[82378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:24 devstack sudo[82378]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG oslo_concurrency.processutils [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.394s {{(pid=82231) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:24 devstack cinder-volume[82231]: DEBUG cinder.manager [None req-bc27e4ec-45fb-4194-81a5-2af44d4b8f01 None None] Notifying Schedulers of capabilities ... {{(pid=82231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:36:28 devstack cinder-volume[82111]: INFO oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Caught SIGTERM, stopping children Apr 08 17:36:28 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Acquiring lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:28 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Acquired lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:28 devstack cinder-volume[82111]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Releasing lock "singleton_lock" {{(pid=82111) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:28 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Stop services. {{(pid=82111) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 08 17:36:28 devstack cinder-volume[82111]: DEBUG oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Killing children. {{(pid=82111) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 08 17:36:28 devstack cinder-volume[82111]: INFO oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Waiting on 1 children to exit Apr 08 17:36:30 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Acquiring lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:30 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Acquired lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:30 devstack cinder-volume[82231]: DEBUG oslo_concurrency.lockutils [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Releasing lock "singleton_lock" {{(pid=82231) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:30 devstack cinder-volume[82231]: WARNING amqp [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 17:36:30 devstack cinder-volume[82231]: WARNING amqp [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 08 17:36:30 devstack cinder-volume[82111]: INFO oslo_service.backend._eventlet.service [None req-60bc4781-0397-4397-8ee4-f309b7a6f3d5 None None] Child 82231 exited with status 0 Apr 08 17:36:30 devstack cinder-volume[82453]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 08 17:36:30 devstack cinder-volume[82453]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 17:36:30 devstack cinder-volume[82453]: we strongly recommend against using it for new projects. Apr 08 17:36:30 devstack cinder-volume[82453]: If you are already using Eventlet, we recommend migrating to a different Apr 08 17:36:30 devstack cinder-volume[82453]: framework. For more detail see Apr 08 17:36:30 devstack cinder-volume[82453]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 17:36:30 devstack cinder-volume[82453]: import eventlet # noqa Apr 08 17:36:32 devstack cinder-volume[82453]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 08 17:36:32 devstack cinder-volume[82453]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 08 17:36:32 devstack cinder-volume[82453]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82453) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 08 17:36:32 devstack cinder-volume[82453]: INFO dbcounter [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Registered counter for database cinder Apr 08 17:36:32 devstack cinder-volume[82453]: DEBUG oslo_db.sqlalchemy.engines [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG dbcounter [-] [82453] Writer thread running {{(pid=82453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:36:33 devstack cinder-volume[82453]: INFO cinder.rpc [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 08 17:36:33 devstack cinder-volume[82453]: INFO cinder.rpc [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_db.sqlalchemy.engines [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:33 devstack cinder-volume[82453]: INFO cinder.volume.manager [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Determined volume DB was empty at startup. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG cinder.volume.manager [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82453) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 08 17:36:33 devstack cinder-volume[82453]: WARNING stevedore.named [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 08 17:36:33 devstack cinder-volume[82453]: WARNING castellan.key_manager [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:36:33 devstack cinder-volume[82453]: WARNING cinder.keymgr.conf_key_mgr [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 08 17:36:33 devstack cinder-volume[82453]: INFO cinder.volume.manager [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_db.sqlalchemy.engines [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:33 devstack cinder-volume[82453]: INFO oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Starting 1 workers Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Started child 82664 {{(pid=82453) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Full set of CONF: {{(pid=82453) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] ******************************************************************************** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Configuration options gathered from: {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] ================================================================================ {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] allow_availability_zone_fallback = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] allow_compression_on_image_upload = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] allowed_direct_url_schemes = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] api_rate_limit = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] auth_strategy = keystone {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_availability_zone = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_host = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_stats_polling_interval = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backup_api_class = cinder.backup.api.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backup_name_template = backup-%s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backup_use_same_host = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backup_use_temp_snapshot = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] chap_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] chap_username = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_internal_tenant_project_id = 951a179555034e7fb8a087dd4fa8f5da {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_internal_tenant_user_id = e907d66f240649c182029c6464c41571 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cluster = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] compression_format = gzip {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] compute_api_class = cinder.compute.nova.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] config_dir = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] config_source = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] control_exchange = openstack {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] debug = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] default_availability_zone = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] default_group_type = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] default_volume_type = QuobyteHD {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] disk_geometry = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_client_cert = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_client_cert_key = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_data_namespace = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_ssl_cert_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_ssl_cert_verify = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] driver_use_ssl = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] enable_new_services = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] enable_unsupported_driver = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] enabled_backends = ['QuobyteHD'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] enforce_multipath_for_image_xfer = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] filter_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_api_insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_api_ssl_compression = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_ca_certificates_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_catalog_info = image:glance:publicURL {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_num_retries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance_request_timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] goodness_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] graceful_shutdown_timeout = 5 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] group_api_class = cinder.group.api.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] host = devstack {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_compress_on_upload = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_conversion_address_space_limit = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_conversion_cpu_limit = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_conversion_disable = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_upload_use_cinder_backend = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82664]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_upload_use_internal_tenant = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_volume_cache_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_volume_cache_max_count = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] image_volume_cache_max_size_gb = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] init_host_max_objects_retrieval = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] instance_format = [instance: %(uuid)s] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iscsi_target_flags = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iscsi_write_cache = on {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iser_helper = tgtadm {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iser_ip_address = 192.168.122.132 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iser_port = 3260 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_color = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_config_append = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_dir = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_options = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_rotate_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_rotate_interval_type = days {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] log_rotation_type = none {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] max_age = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] max_logfile_count = 30 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] max_logfile_size_mb = 200 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] max_over_subscription_ratio = 20.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] message_reap_interval = 86400 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] message_ttl = 2592000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] migration_create_volume_timeout_secs = 300 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] monkey_patch = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] monkey_patch_modules = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] my_ip = 192.168.122.132 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] no_snapshot_gb_quota = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] num_iser_scan_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] num_shell_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] num_volume_device_scan_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] nvmeof_conn_info_version = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] nvmet_ns_id = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] nvmet_port_id = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_max_limit = 1000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_ext_list = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_listen_port = 8776 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_use_ssl = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] osapi_volume_workers = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] per_volume_size_limit = -1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] periodic_fuzzy_delay = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] periodic_interval = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] public_endpoint = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] publish_errors = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_backup_gigabytes = 1000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_backups = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_gigabytes = 1000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_groups = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_snapshots = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] quota_volumes = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] rate_limit_burst = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] rate_limit_except_level = CRITICAL {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] rate_limit_interval = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] reinit_driver_count = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] replication_device = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] report_discard_supported = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] report_interval = 120 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] reservation_clean_interval = 86400 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] reservation_expire = 86400 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] reserved_image_namespaces = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] reserved_percentage = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] rpc_response_timeout = 120 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] run_external_periodic_tasks = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] scst_target_driver = iscsi {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] scst_target_iqn_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_down_time = 720 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] shell_completion = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] snapshot_name_template = snapshot-%s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] split_loggers = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] state_path = /opt/stack/data/cinder {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] storage_availability_zone = nova {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] storage_protocol = iSCSI {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] syslog_log_facility = LOG_USER {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_helper = lioadm {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_ip_address = 192.168.122.132 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_port = 3260 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_protocol = iscsi {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] target_secondary_ip_addresses = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] trace_flags = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] transport_url = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] until_refresh = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_chap_auth = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_default_quota_class = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_journal = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_json = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_multipath_for_image_xfer = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_stderr = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] use_syslog = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] verify_glance_signatures = enabled {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_api_class = cinder.volume.api.API {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_backend_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_clear = zero {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_clear_ionice = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_clear_size = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_copy_bps_limit = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_dd_blocksize = 1M {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_name_template = volume-%s {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_service_inithost_offload = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volume_usage_audit_period = month {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] zoning_mode = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack quobyte-client[82675]: Reading configuration file: /etc/quobyte/client.cfg Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_concurrency.disable_process_locking = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack quobyte-client[82675]: Invalid parameters found, error: missing mount point. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack quobyte-client[82675]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 08 17:36:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 08 17:36:33 devstack quobyte-client[82675]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.admin_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82664) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.admin_token = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.admin_user = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_admin_prefix = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_port = 35357 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_protocol = https {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_section = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_type = password {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_uri = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.auth_version = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.cache = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.identity_uri = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.include_service_catalog = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.interface = public {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_password = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcache_username = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.region_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.service_type = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack sudo[82676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.backend = dogpile.cache.null {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.backend_argument = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.backend_expiration_time = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.config_prefix = cache.oslo {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack sudo[82676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.debug_cache_backend = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.enable_retry_client = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.enable_socket_keepalive = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.enforce_fips_mode = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.expiration_time = 600 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.hashclient_retry_attempts = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_dead_retry = 300 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_pool_maxsize = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_sasl_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.proxies = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.redis_db = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.redis_server = localhost:6379 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.retry_attempts = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.retry_delay = 0.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.socket_keepalive_count = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.socket_keepalive_idle = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.socket_keepalive_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.socket_timeout = 1.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.tls_allowed_ciphers = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.tls_cafile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.tls_certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.tls_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.tls_keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cache.username = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] coordination.backend_url = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.asyncio_connection = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.asyncio_slave_connection = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.backend = sqlalchemy {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.connection = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.connection_debug = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.connection_parameters = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.connection_recycle_time = 3600 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.connection_trace = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.db_inc_retry_interval = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.db_max_retries = 20 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.db_max_retry_interval = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.db_retry_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.max_overflow = 50 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.max_pool_size = 5 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.max_retries = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.mysql_wsrep_sync_wait = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.pool_timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.retry_interval = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.slave_connection = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.sqlite_synchronous = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.synchronous_reader = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] database.use_db_reconnect = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.connection_string = messaging:// {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.es_doc_type = notification {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.es_scroll_size = 10000 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.es_scroll_time = 2m {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.filter_error_trace = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.hmac_keys = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.sentinel_service_name = mymaster {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.socket_timeout = 0.1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.trace_requests = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler.trace_sqlalchemy = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler_jaeger.process_tags = {} {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler_jaeger.service_name_prefix = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] profiler_otlp.service_name_prefix = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.enforce_new_defaults = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: WARNING oslo_config.cfg [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.enforce_scope = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.policy_default_rule = default {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.policy_file = policy.yaml {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.group = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.helper_command = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] privsep_osbrick.user = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.group = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.helper_command = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] cinder_sys_admin.user = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.auth_section = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.auth_type = password {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.cafile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.collect_timing = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.send_service_user_token = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.split_loggers = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] service_user.timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.auth_section = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.auth_type = password {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.collect_timing = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.region_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.split_loggers = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] glance.timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.backend_availability_zone = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.chap_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.chap_username = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.disk_geometry = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_client_cert = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_client_cert_key = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_data_namespace = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.driver_use_ssl = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.extra_capabilities = {} {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.filter_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.goodness_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iscsi_target_flags = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iscsi_write_cache = on {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iser_helper = tgtadm {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iser_port = 3260 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_host = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_login = admin {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_mount_options = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_private_key = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_share_path = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_ssh_port = 22 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.num_shell_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.quobyte_volume_url = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.replication_device = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.report_discard_supported = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.reserved_percentage = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82664) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 08 17:36:33 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Running cmd (subprocess): mount.quobyte {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_helper = tgtadm {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_port = 3260 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_protocol = iscsi {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.trace_flags = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.unique_fqdn_network = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.use_chap_auth = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_backend_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_clear = zero {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_clear_ionice = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_clear_size = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_reports.file_event_handler = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_reports.log_dir = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.backend_availability_zone = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.backend_host = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.chap_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.chap_username = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.chiscsi_conf = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.disk_geometry = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_client_cert = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_data_namespace = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.driver_use_ssl = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.extra_capabilities = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.filter_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.goodness_function = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iscsi_target_flags = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iscsi_write_cache = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iser_helper = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iser_ip_address = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iser_port = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.iser_target_prefix = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_host = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_login = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_mount_options = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_password = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_private_key = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_share_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_ssh_port = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.num_shell_tries = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nvmet_ns_id = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.nvmet_port_id = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.replication_device = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.report_discard_supported = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.reserved_percentage = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.scst_target_driver = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.storage_protocol = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_helper = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_ip_address = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_port = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_prefix = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_protocol = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.trace_flags = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.unique_fqdn_network = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.use_chap_auth = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_clear = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_clear_ionice = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_clear_size = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] QuobyteHD.volumes_dir = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_notifications.driver = [] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_notifications.retry = -1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] key_manager.fixed_key = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.barbican_api_version = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.barbican_endpoint = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.barbican_endpoint_type = public {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.barbican_region_name = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.cafile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.collect_timing = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.number_of_retries = 60 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.retry_delay = 1 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.send_service_user_token = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.split_loggers = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.verify_ssl = True {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican.verify_ssl_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.auth_section = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.auth_type = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.cafile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.certfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.collect_timing = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.insecure = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.keyfile = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.split_loggers = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] barbican_service_user.timeout = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.approle_role_id = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.approle_secret_id = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.kv_mountpoint = secret {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.kv_path = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.kv_version = 2 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.namespace = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.root_token_id = **** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.ssl_ca_crt_file = None {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.timeout = 60.0 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.use_ssl = False {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 08 17:36:33 devstack cinder-volume[82453]: DEBUG oslo_service.backend._eventlet.service [None req-665fcdd1-74a0-4aa1-bf82-26e9222a956a None None] ******************************************************************************** {{(pid=82453) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:33 devstack sudo[82676]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.volume.driver [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Driver hasn't implemented _init_vendor_properties() Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.volume.driver [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82664) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_db.sqlalchemy.engines [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writer thread running {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.db.sqlalchemy.api [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Building query based on filter {{(pid=82664) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82664) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.keymgr.migration [None req-24887b54-f0c2-4d83-a110-109dbbd68241 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 08 17:36:34 devstack sudo[82693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:34 devstack sudo[82693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:34 devstack sudo[82693]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.394s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Driver initialization completed successfully. Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Initiating service 3 cleanup Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Service 3 cleanup completed. Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.service [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Creating RPC server for service cinder-volume {{(pid=82664) start /opt/stack/cinder/cinder/service.py:231}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.service [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82664) start /opt/stack/cinder/cinder/service.py:237}} Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:36:34 devstack sudo[82699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:36:34 devstack sudo[82699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:36:34 devstack sudo[82699]: pam_unix(sudo:session): session closed for user root Apr 08 17:36:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.383s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:36:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fef77590-ab1a-414e-b00c-29b274f06f4e None None] Driver post RPC initialization completed successfully. Apr 08 17:36:43 devstack cinder-volume[82453]: DEBUG dbcounter [-] [82453] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82453) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:36:44 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:36:44 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=3 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Flow 'volume_create_manager' (7af4c3cb-e85a-4935-970e-45e4f5f999ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca83f79-9da9-434a-b864-612616f4693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca83f79-9da9-434a-b864-612616f4693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1358499260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b5ff48-5e91-4b22-9e75-399654d0e413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bfd91475e7a4695ac364d8c61de0a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='af6250b50cf347c89172f8726983e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29049-2f9f-482a-97c7-612b0cbd59bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf29049-2f9f-482a-97c7-612b0cbd59bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7357c44-e88f-43ce-9570-978c71befc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7357c44-e88f-43ce-9570-978c71befc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b5ff48-5e91-4b22-9e75-399654d0e413', 'volume_name': 'volume-25b5ff48-5e91-4b22-9e75-399654d0e413', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6534e01-cdb7-4764-830f-e1e543abb5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6534e01-cdb7-4764-830f-e1e543abb5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b004695-21ce-49aa-a1e1-904d9c08e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Volume 25b5ff48-5e91-4b22-9e75-399654d0e413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b5ff48-5e91-4b22-9e75-399654d0e413', 'volume_size': 1} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1358499260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b5ff48-5e91-4b22-9e75-399654d0e413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bfd91475e7a4695ac364d8c61de0a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='af6250b50cf347c89172f8726983e344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Creating volume 25b5ff48-5e91-4b22-9e75-399654d0e413 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:37:33 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:33 devstack sudo[83055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 1073741824 Apr 08 17:37:33 devstack sudo[83055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Flow 'volume_create_manager' (5b95bc38-e799-44a9-8697-42da77f357eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2b56f8-7b29-42bc-bb32-5564846c007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2b56f8-7b29-42bc-bb32-5564846c007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1655530280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8298017-f220-46fa-b2bc-655f94d9aada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e191fbaf6954acfb7cca18e394bfec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='2a618c634c5a443283b7b5452867ac38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41ee133-a13a-47df-b288-1d3067d1867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41ee133-a13a-47df-b288-1d3067d1867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942e86c-7195-43a3-be50-9018015d763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942e86c-7195-43a3-be50-9018015d763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8298017-f220-46fa-b2bc-655f94d9aada', 'volume_name': 'volume-a8298017-f220-46fa-b2bc-655f94d9aada', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a78658-cde2-4e31-8f2e-30090b0f7d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a78658-cde2-4e31-8f2e-30090b0f7d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f550d04e-fc1d-4f52-8d2d-19f984fe937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Volume a8298017-f220-46fa-b2bc-655f94d9aada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8298017-f220-46fa-b2bc-655f94d9aada', 'volume_size': 1} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Flow 'volume_create_manager' (3dd26f65-e05d-4913-949a-d0f83f2c25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc887a3-017e-41cb-b8f3-8bdf9d597a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc887a3-017e-41cb-b8f3-8bdf9d597a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1021796310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a711d03e-6110-48f6-a516-d83ce28a4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dc07fb98764e2baf24da0af7c7549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='675375ef64de4df69f0db36cae2467fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24da0ad2-5c71-4534-b5a4-f1ce049f64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24da0ad2-5c71-4534-b5a4-f1ce049f64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e8b7d9-446c-40a0-9bff-67e04d0d5660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e8b7d9-446c-40a0-9bff-67e04d0d5660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a711d03e-6110-48f6-a516-d83ce28a4e6d', 'volume_name': 'volume-a711d03e-6110-48f6-a516-d83ce28a4e6d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4383248b-80b3-4e04-b028-d6caf8e684c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4383248b-80b3-4e04-b028-d6caf8e684c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61aa3a2b-a204-4945-bc6e-6c02067fbda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:34 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Volume a711d03e-6110-48f6-a516-d83ce28a4e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a711d03e-6110-48f6-a516-d83ce28a4e6d', 'volume_size': 1} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:34 devstack sudo[83055]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 1073741824" returned: 0 in 0.549s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:34 devstack sudo[83376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 Apr 08 17:37:34 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:34 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1655530280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8298017-f220-46fa-b2bc-655f94d9aada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e191fbaf6954acfb7cca18e394bfec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='2a618c634c5a443283b7b5452867ac38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Creating volume a8298017-f220-46fa-b2bc-655f94d9aada {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:37:34 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b004695-21ce-49aa-a1e1-904d9c08e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b5ff48-5e91-4b22-9e75-399654d0e413', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3db4d25-2595-451f-b15f-0ca0c99b422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:34 devstack sudo[83387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada 1073741824 Apr 08 17:37:34 devstack sudo[83387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:34 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Volume volume-25b5ff48-5e91-4b22-9e75-399654d0e413 (25b5ff48-5e91-4b22-9e75-399654d0e413): created successfully Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3db4d25-2595-451f-b15f-0ca0c99b422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Flow 'volume_create_manager' (7af4c3cb-e85a-4935-970e-45e4f5f999ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-f9bc5a5b-d9c3-49f6-b122-101676caed7b req-86ed779d-b830-4f20-b1e6-b3e1fa6e243f tempest-VolumesGetTestJSON-1018955968 None] Created volume successfully. Apr 08 17:37:35 devstack sudo[83387]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada 1073741824" returned: 0 in 0.463s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:35 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada Apr 08 17:37:35 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Acquiring lock "cinder-25b5ff48-5e91-4b22-9e75-399654d0e413-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "cinder-25b5ff48-5e91-4b22-9e75-399654d0e413-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Acquiring lock "cinder-quobyte-25b5ff48-5e91-4b22-9e75-399654d0e413" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "cinder-quobyte-25b5ff48-5e91-4b22-9e75-399654d0e413" acquired by "delete_volume" :: waited 0.016s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:35 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp35xj1gxt/privsep.sock'] Apr 08 17:37:35 devstack sudo[83397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp35xj1gxt/privsep.sock Apr 08 17:37:35 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:35 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1021796310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a711d03e-6110-48f6-a516-d83ce28a4e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8dc07fb98764e2baf24da0af7c7549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:34Z,use_quota=True,user_id='675375ef64de4df69f0db36cae2467fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Creating volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:37:35 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f550d04e-fc1d-4f52-8d2d-19f984fe937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8298017-f220-46fa-b2bc-655f94d9aada', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f799705a-4ce5-4502-b7af-e7adf382dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:35 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Volume volume-a8298017-f220-46fa-b2bc-655f94d9aada (a8298017-f220-46fa-b2bc-655f94d9aada): created successfully Apr 08 17:37:35 devstack sudo[83400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d 1073741824 Apr 08 17:37:35 devstack sudo[83400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f799705a-4ce5-4502-b7af-e7adf382dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Flow 'volume_create_manager' (5b95bc38-e799-44a9-8697-42da77f357eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e741ca18-2bf3-42d3-acad-3a6d80c871a8 tempest-VolumesAdminNegativeTest-775300361 None] Created volume successfully. Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 08 17:37:36 devstack sudo[83400]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d 1073741824" returned: 0 in 0.659s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:36 devstack sudo[83431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d Apr 08 17:37:36 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: Apr 08 17:37:36 devstack cinder-volume[82664]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 08 17:37:37 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d" returned: 0 in 0.650s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61aa3a2b-a204-4945-bc6e-6c02067fbda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a711d03e-6110-48f6-a516-d83ce28a4e6d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c81896-46b1-4b92-9c07-a1c7b4530ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:37 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Volume volume-a711d03e-6110-48f6-a516-d83ce28a4e6d (a711d03e-6110-48f6-a516-d83ce28a4e6d): created successfully Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c81896-46b1-4b92-9c07-a1c7b4530ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Flow 'volume_create_manager' (3dd26f65-e05d-4913-949a-d0f83f2c25df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:37 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d902281a-5252-4e99-b025-5471adccebf4 tempest-SnapshotsActionsTest-658126114 None] Created volume successfully. Apr 08 17:37:37 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:37 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Spawned new privsep daemon via rootwrap Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Accepted privsep connection to /tmp/tmp35xj1gxt/privsep.sock {{(pid=82664) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 08 17:37:37 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 08 17:37:37 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 08 17:37:37 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 08 17:37:37 devstack cinder-volume[82664]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83435 Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b123901d-82a7-4769-9b6e-6a408399f9ad]: (2,) {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24fb0f-4e3e-433c-aa0e-95d77ee06046]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Acquiring lock "cinder-a8298017-f220-46fa-b2bc-655f94d9aada-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "cinder-a8298017-f220-46fa-b2bc-655f94d9aada-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Acquiring lock "cinder-quobyte-a8298017-f220-46fa-b2bc-655f94d9aada" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "cinder-quobyte-a8298017-f220-46fa-b2bc-655f94d9aada" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0e85c-9efc-4f36-8158-c4b07fa6f536]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:37 devstack sudo[83443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 Apr 08 17:37:37 devstack sudo[83443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:37 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada Apr 08 17:37:37 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Creating offline snapshot ed837235-a7be-457a-bad2-b9f6bd95e226 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf1817-1a6a-4656-9370-a76529ad06da]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:38 devstack sudo[83457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d Apr 08 17:37:38 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:38 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada" returned: 0 in 0.795s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:38 devstack sudo[83460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada Apr 08 17:37:38 devstack sudo[83460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:38 devstack sudo[83443]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413" returned: 0 in 1.014s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:38 devstack sudo[83462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413 Apr 08 17:37:38 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:39 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d" returned: 0 in 1.052s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:39 devstack sudo[83460]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a8298017-f220-46fa-b2bc-655f94d9aada" returned: 0 in 0.925s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:39 devstack sudo[83472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 1G Apr 08 17:37:39 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "cinder-quobyte-a8298017-f220-46fa-b2bc-655f94d9aada" released by "delete_volume" :: held 1.782s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:39 devstack cinder-volume[82664]: WARNING cinder.quota [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:37:39 devstack cinder-volume[82664]: WARNING cinder.quota [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Created reservations ['2655c053-bccc-4e2b-b3bc-79c018fe9a67', '86096588-d94c-49bf-b95d-8efc7b996cb6', 'd0042c25-ac5b-48e6-8d79-0b085d5f3d63', '97c79e98-a78f-4a64-abc6-ba6417f09cbe'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:37:39 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-25b5ff48-5e91-4b22-9e75-399654d0e413" returned: 0 in 1.055s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "cinder-quobyte-25b5ff48-5e91-4b22-9e75-399654d0e413" released by "delete_volume" :: held 3.888s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:39 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:37:39 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.quota [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Created reservations ['238cde1d-847a-4857-93ab-027dd3a813d2', 'b304fd19-c4a5-4de7-87ea-23bae96e7d36', '193b637e-7cd6-49e1-880a-be0f7f6a9733', '79b75783-f784-416b-ba39-e9727bcb07db'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:39 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:37:39 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:40 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.107s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:40 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:37:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Deleted volume successfully. Apr 08 17:37:40 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 1G" returned: 0 in 1.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b2ac7bb-0527-49b1-bcf6-b863c02ae54f tempest-VolumesAdminNegativeTest-775300361 None] Lock "cinder-a8298017-f220-46fa-b2bc-655f94d9aada-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:40 devstack sudo[83490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:40 devstack sudo[83490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:41 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.087s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:41 devstack cinder-volume[82664]: DEBUG cinder.manager [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:37:41 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Deleted volume successfully. Apr 08 17:37:41 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-8e208958-c1bb-4957-b3c0-7ac6c51e8c13 req-07e0e1ec-1a51-49c5-b504-8b9b5140e4e8 tempest-VolumesGetTestJSON-1018955968 None] Lock "cinder-25b5ff48-5e91-4b22-9e75-399654d0e413-delete_volume" released by "delete_volume" :: held 5.296s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:41 devstack sudo[83490]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.786s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:41 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 is being set with open permissions: ugo+rw Apr 08 17:37:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:41 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:41 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:42 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:42 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info Apr 08 17:37:42 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:42 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:42 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info is being set with open permissions: ugo+rw Apr 08 17:37:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:42 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info Apr 08 17:37:42 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:43 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.info" returned: 0 in 0.543s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6ff34e21-7676-427b-ad8a-b9c430d98e35 tempest-SnapshotsActionsTest-658126114 None] Create snapshot completed successfully Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Creating offline snapshot 6316f604-41e0-47db-a607-684aa2f79522 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1843d306-3cb6-422d-9878-eec0377d9c6c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:45 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:45 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:45 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.639s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:45 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 1G Apr 08 17:37:45 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:46 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 1G" returned: 0 in 0.615s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:46 devstack sudo[83613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 Apr 08 17:37:46 devstack sudo[83613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:47 devstack sudo[83613]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522" returned: 0 in 0.736s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:47 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 is being set with open permissions: ugo+rw Apr 08 17:37:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:47 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 Apr 08 17:37:47 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:47 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522" returned: 0 in 0.849s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-92bc27d5-72e9-41ca-b7e6-6b018913e820 tempest-SnapshotsActionsTest-658126114 None] Create snapshot completed successfully Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-6316f604-41e0-47db-a607-684aa2f79522-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-6316f604-41e0-47db-a607-684aa2f79522-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-6316f604-41e0-47db-a607-684aa2f79522" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-6316f604-41e0-47db-a607-684aa2f79522" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Deleting offline snapshot 6316f604-41e0-47db-a607-684aa2f79522 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] snapshot_file for this snap is: volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f1229-7d66-42cd-84cd-ced6e677c6b6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:48 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 Apr 08 17:37:48 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:49 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522" returned: 0 in 0.627s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c2ac1-3ca9-4ace-9029-f031a65ecf97]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:49 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:49 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:49 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.661s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:49 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 Apr 08 17:37:49 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:50 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522" returned: 0 in 0.672s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:50 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522 Apr 08 17:37:50 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:50 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.6316f604-41e0-47db-a607-684aa2f79522" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-6316f604-41e0-47db-a607-684aa2f79522" released by "_delete_snapshot" :: held 2.517s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_snapshot" :: held 2.535s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:51 devstack cinder-volume[82664]: WARNING cinder.quota [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Created reservations ['44703c6c-899e-486b-af59-fe790d55e1c5', '4fdb44f9-2f92-486e-9d56-b4e40b3fc524', '86b552bb-4e62-4a05-9596-23af16fbd366', 'cbdc5ae2-2f3b-4f70-b480-273bb4828082'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:37:51 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Delete snapshot completed successfully. Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9b531099-118e-4f14-b7f7-684bb555cfd7 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-6316f604-41e0-47db-a607-684aa2f79522-delete_snapshot" released by "delete_snapshot" :: held 2.669s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Creating offline snapshot 051d4baf-94b8-4b20-adb8-0fec5008813f of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8d9c6-197e-4800-81a5-39e83e884b21]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:52 devstack sudo[83652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:52 devstack sudo[83652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Flow 'volume_create_manager' (43665bcb-9365-447c-8b52-8bdbcbceeb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30aaa5f3-713d-483b-bfe4-e9319c39621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30aaa5f3-713d-483b-bfe4-e9319c39621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-158983607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca54781e-d51a-46c2-b815-4227bc9c3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3976805fbd1941da99acec9362fcaed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:52Z,use_quota=True,user_id='47fd04e548584ff7b53bd0c87f09eb70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cf95aa-558c-4f44-afdd-83792df1c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cf95aa-558c-4f44-afdd-83792df1c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c285f69b-9c78-4b20-96f3-414765b97044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c285f69b-9c78-4b20-96f3-414765b97044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca54781e-d51a-46c2-b815-4227bc9c3e72', 'volume_name': 'volume-ca54781e-d51a-46c2-b815-4227bc9c3e72', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c0744d-fc3d-45b4-9e60-7d93ec90ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c0744d-fc3d-45b4-9e60-7d93ec90ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1655d7b7-689a-4214-8526-4d7dd30cc691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:52 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Volume ca54781e-d51a-46c2-b815-4227bc9c3e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca54781e-d51a-46c2-b815-4227bc9c3e72', 'volume_size': 1} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:52 devstack sudo[83652]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.793s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:52 devstack sudo[83659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f 1G Apr 08 17:37:52 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:53 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f 1G" returned: 0 in 0.729s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:53 devstack sudo[83665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f Apr 08 17:37:53 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Flow 'volume_create_manager' (2809f04d-a85f-4fd6-ab18-82e85eda8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093c23f3-9131-4945-adbd-0aa3464f5c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093c23f3-9131-4945-adbd-0aa3464f5c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='0368ba83-7780-4fea-b9a4-d2685b15a103-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df977523-99c5-46bd-aa5e-5d210e071a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f43231e3a4dfaaf1c83f3d5d559c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:54Z,use_quota=True,user_id='11773fa018b14e25ae88c904f13250cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1018cd2-b4cc-4a3e-a1d6-23779cb15f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1018cd2-b4cc-4a3e-a1d6-23779cb15f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60483690-f14c-4681-a6c5-1c48dd3307c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60483690-f14c-4681-a6c5-1c48dd3307c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df977523-99c5-46bd-aa5e-5d210e071a87', 'volume_name': 'volume-df977523-99c5-46bd-aa5e-5d210e071a87', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef7e771-1979-441a-8730-86c166b500bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef7e771-1979-441a-8730-86c166b500bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e2be19-285c-4288-b94e-45e3d1962716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:54 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume df977523-99c5-46bd-aa5e-5d210e071a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df977523-99c5-46bd-aa5e-5d210e071a87', 'volume_size': 1} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:54 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f" returned: 0 in 0.859s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:54 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f is being set with open permissions: ugo+rw Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:54 devstack sudo[83672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f Apr 08 17:37:54 devstack sudo[83672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:54 devstack sudo[83672]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f" returned: 0 in 0.455s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-158983607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca54781e-d51a-46c2-b815-4227bc9c3e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3976805fbd1941da99acec9362fcaed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:52Z,use_quota=True,user_id='47fd04e548584ff7b53bd0c87f09eb70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Creating volume ca54781e-d51a-46c2-b815-4227bc9c3e72 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:37:54 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:37:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:54 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-04a0fe9c-f334-4c83-9281-eaf66c4b030b tempest-SnapshotsActionsTest-658126114 None] Create snapshot completed successfully Apr 08 17:37:54 devstack sudo[83676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 1073741824 Apr 08 17:37:54 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-051d4baf-94b8-4b20-adb8-0fec5008813f-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-051d4baf-94b8-4b20-adb8-0fec5008813f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-051d4baf-94b8-4b20-adb8-0fec5008813f" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-051d4baf-94b8-4b20-adb8-0fec5008813f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Deleting offline snapshot 051d4baf-94b8-4b20-adb8-0fec5008813f of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] snapshot_file for this snap is: volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f633c-a30c-487c-802b-91f29322be04]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:55 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f Apr 08 17:37:55 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:55 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 1073741824" returned: 0 in 0.681s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:55 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 Apr 08 17:37:55 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:55 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f" returned: 0 in 0.750s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e8757-b9a6-4e57-8776-aba1e0796bae]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:56 devstack sudo[83689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:56 devstack sudo[83689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:56 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72" returned: 0 in 0.539s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.855s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:37:54Z,deleted=False,deleted_at=None,display_description='',display_name='0368ba83-7780-4fea-b9a4-d2685b15a103-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df977523-99c5-46bd-aa5e-5d210e071a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f43231e3a4dfaaf1c83f3d5d559c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:37:54Z,use_quota=True,user_id='11773fa018b14e25ae88c904f13250cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Creating volume df977523-99c5-46bd-aa5e-5d210e071a87 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:37:56 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1655d7b7-689a-4214-8526-4d7dd30cc691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca54781e-d51a-46c2-b815-4227bc9c3e72', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6900d341-7a76-4da5-a6af-6adf706cb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:56 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 1073741824 Apr 08 17:37:56 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:56 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Volume volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 (ca54781e-d51a-46c2-b815-4227bc9c3e72): created successfully Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6900d341-7a76-4da5-a6af-6adf706cb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Flow 'volume_create_manager' (43665bcb-9365-447c-8b52-8bdbcbceeb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:56 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-05cf591d-f6e2-4a01-a4fb-dc652f0a0a79 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Created volume successfully. Apr 08 17:37:56 devstack sudo[83689]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.693s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:56 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f Apr 08 17:37:56 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:57 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 1073741824" returned: 0 in 0.976s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:57 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 Apr 08 17:37:57 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:57 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f" returned: 0 in 0.782s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:57 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f Apr 08 17:37:57 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Acquiring lock "cinder-ca54781e-d51a-46c2-b815-4227bc9c3e72-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "cinder-ca54781e-d51a-46c2-b815-4227bc9c3e72-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Acquiring lock "cinder-quobyte-ca54781e-d51a-46c2-b815-4227bc9c3e72" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "cinder-quobyte-ca54781e-d51a-46c2-b815-4227bc9c3e72" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d406c-d3e3-4b54-9f54-3b0ef7a15c3f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:57 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 Apr 08 17:37:57 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:57 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87" returned: 0 in 0.670s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e2be19-285c-4288-b94e-45e3d1962716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df977523-99c5-46bd-aa5e-5d210e071a87', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf1036-4331-4ff7-b822-e166915e9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:37:57 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume volume-df977523-99c5-46bd-aa5e-5d210e071a87 (df977523-99c5-46bd-aa5e-5d210e071a87): created successfully Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf1036-4331-4ff7-b822-e166915e9cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:37:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Flow 'volume_create_manager' (2809f04d-a85f-4fd6-ab18-82e85eda8a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:37:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-e6182ad4-6a80-4b13-bd03-658da3d94089 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Created volume successfully. Apr 08 17:37:58 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.051d4baf-94b8-4b20-adb8-0fec5008813f" returned: 0 in 0.567s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-051d4baf-94b8-4b20-adb8-0fec5008813f" released by "_delete_snapshot" :: held 2.839s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_snapshot" :: held 2.853s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Created reservations ['3a6c8b21-e650-489f-a77a-01f7cf791be4', 'a55efc5e-b3c7-4031-98ba-69cda71aae87', 'cc4a9d26-f44d-4b4e-9a01-33cff8cbfd36', '9ecf3cb0-ac76-4566-bc21-5b696647e4e7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:37:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Delete snapshot completed successfully. Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e96f75fc-9fb7-4015-aff7-044b886148c0 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-051d4baf-94b8-4b20-adb8-0fec5008813f-delete_snapshot" released by "delete_snapshot" :: held 2.985s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:58 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72" returned: 0 in 0.687s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:58 devstack sudo[83718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72 Apr 08 17:37:58 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Creating offline snapshot 3e9ac170-eb52-4eb5-a822-e517f8b8bf43 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752523f-ea05-4a27-9bf8-f65bb5d4e909]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:58 devstack sudo[83720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:37:58 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:58 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ca54781e-d51a-46c2-b815-4227bc9c3e72" returned: 0 in 0.492s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "cinder-quobyte-ca54781e-d51a-46c2-b815-4227bc9c3e72" released by "delete_volume" :: held 1.205s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Created reservations ['e7d5e39f-8abc-4a82-a027-19e35fe34e66', '6b57ec39-bbf4-4fb0-b9e6-9c4588927d3e', '180dcfe0-0d22-4781-815e-a0fec6acf5d0', '843afa34-f95a-47de-b3ce-1ba1feffd722'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:37:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:58 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:37:58 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:59 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.577s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:37:59 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 1G Apr 08 17:37:59 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:37:59 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.614s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:37:59 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Deleted volume successfully. Apr 08 17:37:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7f97d8ca-fab8-4afa-9f05-11d595a5b4d3 tempest-VolumeQuotasNegativeTestJSON-605811127 None] Lock "cinder-ca54781e-d51a-46c2-b815-4227bc9c3e72-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:00 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 1G" returned: 0 in 0.788s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:00 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 Apr 08 17:38:00 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:00 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43" returned: 0 in 0.854s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:00 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 is being set with open permissions: ugo+rw Apr 08 17:38:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:00 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 Apr 08 17:38:00 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:01 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43" returned: 0 in 0.616s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.933s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-713a78bd-f326-41f1-9cbc-ff5ac5edff40 tempest-SnapshotsActionsTest-658126114 None] Create snapshot completed successfully Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-3e9ac170-eb52-4eb5-a822-e517f8b8bf43-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-3e9ac170-eb52-4eb5-a822-e517f8b8bf43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-3e9ac170-eb52-4eb5-a822-e517f8b8bf43" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-3e9ac170-eb52-4eb5-a822-e517f8b8bf43" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Deleting offline snapshot 3e9ac170-eb52-4eb5-a822-e517f8b8bf43 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] snapshot_file for this snap is: volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e535c18f-aabe-4be1-aefb-603c743a3739]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:02 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 Apr 08 17:38:02 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:02 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:02 devstack cinder-volume[82664]: WARNING py.warnings [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 08 17:38:02 devstack cinder-volume[82664]: .first() Apr 08 17:38:02 devstack cinder-volume[82664]: Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43" returned: 0 in 0.724s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d179275-cd9e-415a-8739-f3bdffc4abbc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a656df4-ccb5-4378-b852-c64e9ac74c9e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:02 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 Apr 08 17:38:02 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:02 devstack sudo[83791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:02 devstack sudo[83791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:02 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:02 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:03 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87" returned: 0 in 0.861s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:03 devstack sudo[83791]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:03 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.934s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.766s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f', 'name': 'volume-df977523-99c5-46bd-aa5e-5d210e071a87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deba817c-23fa-4467-9b1c-d09026ca0134', 'enforce_multipath': True} {{(pid=82664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 17:38:03 devstack sudo[83804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 Apr 08 17:38:03 devstack sudo[83804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:03 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-6a0b7903-244c-42ca-9cb9-2a63c1b0c17d req-b1264f93-96ec-467d-95cd-6f35d6e5b2d9 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] attachment_update completed successfully. Apr 08 17:38:04 devstack sudo[83804]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43" returned: 0 in 0.966s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:04 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43 Apr 08 17:38:04 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:05 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.3e9ac170-eb52-4eb5-a822-e517f8b8bf43" returned: 0 in 0.683s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-3e9ac170-eb52-4eb5-a822-e517f8b8bf43" released by "_delete_snapshot" :: held 3.379s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_snapshot" :: held 3.405s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Flow 'volume_create_manager' (ab57e93d-04bb-4b81-94e9-b8c0b289d44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6473566e-f43b-4d17-b09c-1ed6d4723bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6473566e-f43b-4d17-b09c-1ed6d4723bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1171836120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdbb45a-f9a9-4180-9396-4ca386c08efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2f4a3f93f4c6db1131e1e73479ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:05Z,use_quota=True,user_id='712f0ae26c744ae8b30b89a6f773bec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c8ebce-6816-4f8c-a463-8c12c09827e5),volume_type_id=f6c8ebce-6816-4f8c-a463-8c12c09827e5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae3dc20-baed-4420-ab95-a57d43cd2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae3dc20-baed-4420-ab95-a57d43cd2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c9e0f0-36c3-45d9-8406-a58c26fe226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c9e0f0-36c3-45d9-8406-a58c26fe226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdbb45a-f9a9-4180-9396-4ca386c08efd', 'volume_name': 'volume-efdbb45a-f9a9-4180-9396-4ca386c08efd', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cce9a31-b817-4aec-a937-6555e94dfd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cce9a31-b817-4aec-a937-6555e94dfd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40899c47-c1b2-4aa4-ab4f-007d0febe1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:05 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Volume efdbb45a-f9a9-4180-9396-4ca386c08efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdbb45a-f9a9-4180-9396-4ca386c08efd', 'volume_size': 1} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1171836120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdbb45a-f9a9-4180-9396-4ca386c08efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2f4a3f93f4c6db1131e1e73479ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:05Z,use_quota=True,user_id='712f0ae26c744ae8b30b89a6f773bec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c8ebce-6816-4f8c-a463-8c12c09827e5),volume_type_id=f6c8ebce-6816-4f8c-a463-8c12c09827e5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Creating volume efdbb45a-f9a9-4180-9396-4ca386c08efd {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:05 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Created reservations ['60db98ad-b6ae-4b47-8442-1968014e9782', '3aef540b-3191-446b-adfd-e5c433758b6e', '49dd7a61-b6b6-4e18-bade-600d2c15a2b1', 'ef243dfc-3201-4c56-ab8d-45b37d030a88'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:05 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd 1073741824 Apr 08 17:38:05 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Delete snapshot completed successfully. Apr 08 17:38:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6acaf5f6-f2d6-4e94-84b7-d666cd9fd12a tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-3e9ac170-eb52-4eb5-a822-e517f8b8bf43-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:06 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd 1073741824" returned: 0 in 0.608s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:06 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd Apr 08 17:38:06 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:06 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd" returned: 0 in 0.586s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.216s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Creating offline snapshot 0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40899c47-c1b2-4aa4-ab4f-007d0febe1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdbb45a-f9a9-4180-9396-4ca386c08efd', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733844d-a100-4e13-a605-de758433e006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ca168-bf88-4a04-be9a-99136d1a5dd1]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Volume volume-efdbb45a-f9a9-4180-9396-4ca386c08efd (efdbb45a-f9a9-4180-9396-4ca386c08efd): created successfully Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733844d-a100-4e13-a605-de758433e006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Flow 'volume_create_manager' (ab57e93d-04bb-4b81-94e9-b8c0b289d44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7d11ff6a-cd8c-414a-99b4-a7f864b77355 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Created volume successfully. Apr 08 17:38:06 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:06 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:07 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.599s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:07 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 1G Apr 08 17:38:07 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:08 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:08 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:08 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 1G" returned: 0 in 0.777s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:08 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 Apr 08 17:38:08 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:08 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.559s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:08 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f7e12bb1-14bd-4faf-95f6-5e554e47b847 tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Retype volume completed successfully. Apr 08 17:38:08 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" returned: 0 in 0.621s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:08 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 is being set with open permissions: ugo+rw Apr 08 17:38:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:08 devstack sudo[83909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 Apr 08 17:38:08 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "cinder-efdbb45a-f9a9-4180-9396-4ca386c08efd-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "cinder-efdbb45a-f9a9-4180-9396-4ca386c08efd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "cinder-quobyte-efdbb45a-f9a9-4180-9396-4ca386c08efd" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "cinder-quobyte-efdbb45a-f9a9-4180-9396-4ca386c08efd" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eabc67-4f96-482a-8dcd-92249878a380]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:09 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" returned: 0 in 0.791s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a4ededa8-7a52-434e-9474-6c2ed22c7d01 tempest-SnapshotsActionsTest-658126114 None] Create snapshot completed successfully Apr 08 17:38:09 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd Apr 08 17:38:09 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:10 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd" returned: 0 in 0.748s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:10 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd Apr 08 17:38:10 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:10 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-efdbb45a-f9a9-4180-9396-4ca386c08efd" returned: 0 in 0.398s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "cinder-quobyte-efdbb45a-f9a9-4180-9396-4ca386c08efd" released by "delete_volume" :: held 1.171s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:10 devstack cinder-volume[82664]: WARNING cinder.quota [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:38:10 devstack cinder-volume[82664]: WARNING cinder.quota [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Created reservations ['d1b689fe-6e82-4f67-a48c-6f3dbaddb522', '1c146eae-78b6-4a6d-88ab-af8d9301b937', '93a3acd9-ba76-43d7-bbc3-4749c910bacb', '7077db17-8341-4465-a583-e784bea46c15'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:10 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:10 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Acquiring lock "cinder-quobyte-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Deleting offline snapshot 0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] snapshot_file for this snap is: volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[94194ee9-872f-4c57-8d2a-b4ef91dac3b8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:11 devstack sudo[84260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 Apr 08 17:38:11 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:11 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Deleted volume successfully. Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e9cc821a-653e-4fe3-9e57-248098ba1bcb tempest-VolumeRetypeWithoutMigrationTest-120902874 None] Lock "cinder-efdbb45a-f9a9-4180-9396-4ca386c08efd-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:11 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" returned: 0 in 0.610s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b64280a-2bc5-45b6-85ff-17d93c7ffe5c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:11 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:11 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:12 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.550s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:12 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 Apr 08 17:38:12 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:12 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" returned: 0 in 0.632s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:12 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4 Apr 08 17:38:12 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:13 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" returned: 0 in 0.465s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4" released by "_delete_snapshot" :: held 2.317s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_snapshot" :: held 2.338s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:13 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Created reservations ['e5faa75f-442d-474d-9554-03a79dc370aa', '5f868e30-3851-48e7-9e56-f2ad5a477397', 'f7386177-adec-40bf-a501-44e4fb8c2889', '1ef2b4a2-275e-459b-84ad-8096f6d24d5c'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Delete snapshot completed successfully. Apr 08 17:38:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4bdda98a-848e-4c78-a953-bbdd3b3f3160 tempest-SnapshotsActionsTest-1429088978 None] Lock "cinder-0b1fd57f-3674-4649-80ea-e0d6a0d06ac4-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "cinder-ed837235-a7be-457a-bad2-b9f6bd95e226-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-ed837235-a7be-457a-bad2-b9f6bd95e226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "cinder-quobyte-ed837235-a7be-457a-bad2-b9f6bd95e226" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-ed837235-a7be-457a-bad2-b9f6bd95e226" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Deleting offline snapshot ed837235-a7be-457a-bad2-b9f6bd95e226 of volume a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] snapshot_file for this snap is: volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f343f859-c47a-4a78-8b13-58d7d84248e5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:14 devstack sudo[84287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:14 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:15 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.633s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a711d03e-6110-48f6-a516-d83ce28a4e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ac33d8-38e2-4847-afcf-75da489fe5fc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:15 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d Apr 08 17:38:15 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:15 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d" returned: 0 in 0.646s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:15 devstack sudo[84302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:15 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:16 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.547s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:16 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226 Apr 08 17:38:16 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:16 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d.ed837235-a7be-457a-bad2-b9f6bd95e226" returned: 0 in 0.579s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-ed837235-a7be-457a-bad2-b9f6bd95e226" released by "_delete_snapshot" :: held 2.484s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_snapshot" :: held 2.501s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Created reservations ['7bb9898c-d108-46a9-b987-366271545245', '64a617db-2a4d-4bb2-845a-79600f146c1d', '1add1c7a-eb4d-40b9-93b2-d0b6c426d2ae', '6f3d1bf1-94c2-42e7-a3f5-bd7ae4c11be7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Delete snapshot completed successfully. Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-242930b7-1edd-4c9f-8ded-ccd237683d5a tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-ed837235-a7be-457a-bad2-b9f6bd95e226-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "cinder-a711d03e-6110-48f6-a516-d83ce28a4e6d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-a711d03e-6110-48f6-a516-d83ce28a4e6d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238b30d-6449-4d1a-b766-47f32c6c2b9e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:17 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d Apr 08 17:38:17 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:18 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d" returned: 0 in 0.682s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:18 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d Apr 08 17:38:18 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:18 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a711d03e-6110-48f6-a516-d83ce28a4e6d" returned: 0 in 0.491s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-quobyte-a711d03e-6110-48f6-a516-d83ce28a4e6d" released by "delete_volume" :: held 1.202s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Created reservations ['0e9e251f-9ca7-45db-b231-3da4d8cbb4bf', 'd7df9ef6-8cb8-4efd-a36f-7bffd00d611e', '7aae170a-4165-4396-84bc-5056ae0f90e2', '3cfc1138-1095-4dfb-8185-9a8b3aa24c51'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:19 devstack sudo[84336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:19 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:19 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Deleted volume successfully. Apr 08 17:38:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a69b74d5-5253-4c1d-ad30-6a2ce5599a8b tempest-SnapshotsActionsTest-658126114 None] Lock "cinder-a711d03e-6110-48f6-a516-d83ce28a4e6d-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Flow 'volume_create_manager' (a5b4a847-40a6-466f-a3b6-66655ee903f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba4e030-00b2-49d2-8b65-f763a03a641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba4e030-00b2-49d2-8b65-f763a03a641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-549189231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2f5dc1-98f1-4d27-9a63-39a94edd92df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91f1ae25f7c452cb8ae1c289263522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:24Z,use_quota=True,user_id='637caffbfce849d081428f6518c21c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839036b3-7e61-4f13-bd48-770a3bc5e507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839036b3-7e61-4f13-bd48-770a3bc5e507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdf578d-a7e5-4582-a25b-4cb80749f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdf578d-a7e5-4582-a25b-4cb80749f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2f5dc1-98f1-4d27-9a63-39a94edd92df', 'volume_name': 'volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae034e-4a06-4373-8e4b-6737329e5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae034e-4a06-4373-8e4b-6737329e5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c544e7d3-c85d-4a47-9cb0-22ae1c4f8c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:23 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Volume 5e2f5dc1-98f1-4d27-9a63-39a94edd92df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df', 'volume_size': 1} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-549189231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2f5dc1-98f1-4d27-9a63-39a94edd92df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91f1ae25f7c452cb8ae1c289263522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:24Z,use_quota=True,user_id='637caffbfce849d081428f6518c21c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Creating volume 5e2f5dc1-98f1-4d27-9a63-39a94edd92df {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:23 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:23 devstack sudo[84401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df 1073741824 Apr 08 17:38:23 devstack sudo[84401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:24 devstack sudo[84401]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df 1073741824" returned: 0 in 0.995s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:24 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=88,cinder:SELECT=89,cinder:INSERT=25,cinder:DELETE=6 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:38:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:24 devstack sudo[84422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df Apr 08 17:38:24 devstack sudo[84422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:25 devstack sudo[84422]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" returned: 0 in 0.770s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c544e7d3-c85d-4a47-9cb0-22ae1c4f8c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5857d-ad3a-4e2d-bfcf-ec2157f7dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=88,cinder:UPDATE=110,cinder:INSERT=23,cinder:DELETE=10 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:38:25 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Volume volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df (5e2f5dc1-98f1-4d27-9a63-39a94edd92df): created successfully Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf5857d-ad3a-4e2d-bfcf-ec2157f7dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Flow 'volume_create_manager' (a5b4a847-40a6-466f-a3b6-66655ee903f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:25 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-03102e67-3dec-460b-89ab-b4a02bd6df5d tempest-DeleteServersTestJSON-2020937988 None] Created volume successfully. Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Flow 'volume_create_manager' (1e527926-ff74-4deb-80ee-cc1e2f990f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a578bd-d919-489b-b607-8ebe25d72941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a578bd-d919-489b-b607-8ebe25d72941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415373562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe3578b-ea35-49fc-9a9d-f7afe7771749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf103097ad4d4dd0938bb3ae87c3b8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:29Z,use_quota=True,user_id='4c48e4caf8f7454788d1f9591ce60ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6996dd-fc4a-460c-bded-68a6e367cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6996dd-fc4a-460c-bded-68a6e367cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3f30ad-f20b-4842-94c2-8ed043dd03a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:28 devstack cinder-volume[82664]: DEBUG cinder.image.glance [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Creating Keystone auth plugin from conf {{(pid=82664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97e62d4-6f6d-4705-96f7-c81da637f12f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3f30ad-f20b-4842-94c2-8ed043dd03a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9fe3578b-ea35-49fc-9a9d-f7afe7771749', 'volume_name': 'volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e09565-a904-4bdd-8817-09fe59675f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e09565-a904-4bdd-8817-09fe59675f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4bf6c4-e24d-4b69-b168-8ceb313f22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:29 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Trying to clone 9fe3578b-ea35-49fc-9a9d-f7afe7771749 from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]). {{(pid=82664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 08 17:38:29 devstack sudo[84494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df Apr 08 17:38:29 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:29 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 17:38:29 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Image download 20.69 MB at 20.69 MB/s Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc87931-83e8-4cd4-a746-cdb9f93cef8d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:30 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD Apr 08 17:38:30 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:30 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" returned: 0 in 1.290s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.302s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f', 'name': 'volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25b9ddde-602a-4743-bb89-15a3399ab962', 'enforce_multipath': True} {{(pid=82664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 17:38:30 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-62b02361-02c9-43cd-9bea-feda55b86c34 req-5b6168d2-122b-465d-b042-488c7a6d43da tempest-DeleteServersTestJSON-2020937988 None] attachment_update completed successfully. Apr 08 17:38:30 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:30 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 is fetched for user 4c48e4caf8f7454788d1f9591ce60ba2. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[25067ef3-6365-4fd9-b314-c4a6d24fa85c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:31 devstack sudo[84527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD Apr 08 17:38:31 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:31 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1415373562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe3578b-ea35-49fc-9a9d-f7afe7771749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf103097ad4d4dd0938bb3ae87c3b8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:29Z,use_quota=True,user_id='4c48e4caf8f7454788d1f9591ce60ba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Creating volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:31 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:31 devstack sudo[84537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1073741824 Apr 08 17:38:31 devstack sudo[84537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:32 devstack sudo[84537]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1073741824" returned: 0 in 0.834s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:32 devstack sudo[84543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:32 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:33 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 0 in 0.637s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Attempting download of 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0dd042-9c56-496a-b6a9-e556cb77c66b]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_ {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:33 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_ Apr 08 17:38:33 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:34 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_" returned: 0 in 0.679s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_ {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:34 devstack sudo[84556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_ Apr 08 17:38:34 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:35 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_" returned: 1 in 0.970s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_a71rzw9_' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[81784ab4-b8dc-4fbb-8285-55162582c49c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:35 devstack sudo[84602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD Apr 08 17:38:35 devstack sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:35 devstack sudo[84602]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 was qcow2, converting to raw {{(pid=82664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 17:38:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:36 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:36 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:37 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 0 in 1.344s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_cfp25rcidevstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:38:37 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Converted 112.00 MB image at 83.25 MB/s Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:37 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1G Apr 08 17:38:37 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:37 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 1G" returned: 0 in 0.543s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc5b27-4408-48fb-bced-479d12bf0c6e]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:37 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:37 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:38 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 0 in 0.601s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:38 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:38 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:38 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-083c4fcc-9133-41cf-89ed-2e2b48284ca3 req-240e9e23-37cd-480d-a4be-fe59ebb9a4e8 tempest-DeleteServersTestJSON-2020937988 None] Terminate volume connection completed successfully. Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-083c4fcc-9133-41cf-89ed-2e2b48284ca3 req-240e9e23-37cd-480d-a4be-fe59ebb9a4e8 tempest-DeleteServersTestJSON-2020937988 None] Deleting attachment 25b9ddde-602a-4743-bb89-15a3399ab962. {{(pid=82664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Flow 'volume_create_manager' (833808de-e85e-4eaf-b78a-087ef7d8316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d546a2cd-1f6d-4e6b-a994-d95c820de648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d546a2cd-1f6d-4e6b-a994-d95c820de648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-3400706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0376ede4-6987-4aa1-b492-c8cd887a7fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbaba58c01e41fb94330155232b4e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:39Z,use_quota=True,user_id='693861d3da4a4ebfb87b09d59c0008c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee6dc4-ccc5-41c6-a896-ba8f8526340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee6dc4-ccc5-41c6-a896-ba8f8526340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c0772-b8bf-4473-b6e5-06be12e8b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c0772-b8bf-4473-b6e5-06be12e8b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0376ede4-6987-4aa1-b492-c8cd887a7fb2', 'volume_name': 'volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6b4adc-48a0-41fc-893f-e9f2d11cc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6b4adc-48a0-41fc-893f-e9f2d11cc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9445f67d-a8d3-46dd-a67d-93da130ab352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:38 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Volume 0376ede4-6987-4aa1-b492-c8cd887a7fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2', 'volume_size': 1} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-3400706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0376ede4-6987-4aa1-b492-c8cd887a7fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fbaba58c01e41fb94330155232b4e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:39Z,use_quota=True,user_id='693861d3da4a4ebfb87b09d59c0008c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Creating volume 0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:38 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:38 devstack sudo[84693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 1073741824 Apr 08 17:38:38 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:39 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 1 in 0.505s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Downloaded image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749 successfully. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 for user 4c48e4caf8f7454788d1f9591ce60ba2 is deleted. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Marking volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749 as bootable. {{(pid=82664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Copying metadata from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 to 9fe3578b-ea35-49fc-9a9d-f7afe7771749. {{(pid=82664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Creating volume glance metadata for volume 9fe3578b-ea35-49fc-9a9d-f7afe7771749 backed by image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4bf6c4-e24d-4b69-b168-8ceb313f22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bff6d5c-48f6-470c-8b27-b552bf8b9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:39 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Volume volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 (9fe3578b-ea35-49fc-9a9d-f7afe7771749): created successfully Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bff6d5c-48f6-470c-8b27-b552bf8b9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Flow 'volume_create_manager' (1e527926-ff74-4deb-80ee-cc1e2f990f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-84e0142f-0183-4637-9662-34a5132bd271 tempest-VolumesImageMetadata-1990957993 None] Created volume successfully. Apr 08 17:38:39 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 1073741824" returned: 0 in 0.527s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:39 devstack sudo[84701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 Apr 08 17:38:39 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:39 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2" returned: 0 in 0.455s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9445f67d-a8d3-46dd-a67d-93da130ab352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebbafa7-aaeb-4423-a105-e7ef9c0e0e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:39 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Volume volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 (0376ede4-6987-4aa1-b492-c8cd887a7fb2): created successfully Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebbafa7-aaeb-4423-a105-e7ef9c0e0e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Flow 'volume_create_manager' (833808de-e85e-4eaf-b78a-087ef7d8316e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-df8d383d-87fa-42f6-b05a-085cf33e4dc7 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Created volume successfully. Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Acquiring lock "cinder-9fe3578b-ea35-49fc-9a9d-f7afe7771749-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "cinder-9fe3578b-ea35-49fc-9a9d-f7afe7771749-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Acquiring lock "cinder-quobyte-9fe3578b-ea35-49fc-9a9d-f7afe7771749" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "cinder-quobyte-9fe3578b-ea35-49fc-9a9d-f7afe7771749" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62a4a4-6324-4b0f-b956-2fdb0f472f85]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:40 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:40 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:40 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 0 in 0.456s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:40 devstack sudo[84708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:40 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:40 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Creating offline snapshot 53c46a71-65b4-432e-b8a8-f1e9c8645928 of volume 0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 1 in 0.521s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5de997-725a-4cb1-8fa5-d7e0381ac7bb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:41 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749 Apr 08 17:38:41 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:41 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 Apr 08 17:38:41 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:41 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9fe3578b-ea35-49fc-9a9d-f7afe7771749" returned: 0 in 0.406s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "cinder-quobyte-9fe3578b-ea35-49fc-9a9d-f7afe7771749" released by "delete_volume" :: held 1.425s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Created reservations ['7f5ec439-f900-4859-8f93-33dd8e88458d', 'e6d97de2-8a7a-41e7-9fbf-3fbc27f24f60', 'f69b3d53-19bc-45ee-8b54-7681829a032c', 'b2c65350-dff0-4da9-9440-b5cb15a86240'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:41 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2" returned: 0 in 0.487s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:41 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:41 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:41 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 1G Apr 08 17:38:41 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:41 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:41 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Deleted volume successfully. Apr 08 17:38:41 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 1G" returned: 0 in 0.508s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:42 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7628a30d-d4b1-43f4-91aa-ae16b9d54615 tempest-VolumesImageMetadata-1990957993 None] Lock "cinder-9fe3578b-ea35-49fc-9a9d-f7afe7771749-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:42 devstack sudo[84729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 Apr 08 17:38:42 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:42 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:42 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 is being set with open permissions: ugo+rw Apr 08 17:38:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:42 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 Apr 08 17:38:42 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:42 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928" returned: 0 in 0.456s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:42 devstack sudo[84740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info Apr 08 17:38:42 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:43 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:43 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info is being set with open permissions: ugo+rw Apr 08 17:38:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:43 devstack sudo[84743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info Apr 08 17:38:43 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:43 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.info" returned: 0 in 0.448s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-95b67a31-8cee-43da-894d-b70ba9ab13af tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Create snapshot completed successfully Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Flow 'volume_create_manager' (b3eb93fa-8677-440c-a15b-71a399f6056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325d911d-179f-410e-94eb-340c003f9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325d911d-179f-410e-94eb-340c003f9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2074397084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63f4171-1c19-4ac2-aea3-723c2d1b9122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a70c3158d3b4585b62f283c1ff77021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:44Z,use_quota=True,user_id='c43efd3d20bd4deb997b47a74ad11c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ccc84e-a261-4cc7-aea9-a518a63bf72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ccc84e-a261-4cc7-aea9-a518a63bf72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca56175-ac89-4bb8-a8e0-f680ea6705e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca56175-ac89-4bb8-a8e0-f680ea6705e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63f4171-1c19-4ac2-aea3-723c2d1b9122', 'volume_name': 'volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e7e35c-f703-41df-993f-ba69c40aaa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e7e35c-f703-41df-993f-ba69c40aaa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397cf2ee-70b1-4363-bf59-0d8577200551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Volume d63f4171-1c19-4ac2-aea3-723c2d1b9122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122', 'volume_size': 1} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2074397084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63f4171-1c19-4ac2-aea3-723c2d1b9122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a70c3158d3b4585b62f283c1ff77021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:44Z,use_quota=True,user_id='c43efd3d20bd4deb997b47a74ad11c23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Creating volume d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:44 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:44 devstack sudo[84748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 1073741824 Apr 08 17:38:44 devstack sudo[84748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "cinder-53c46a71-65b4-432e-b8a8-f1e9c8645928-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-53c46a71-65b4-432e-b8a8-f1e9c8645928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "cinder-quobyte-53c46a71-65b4-432e-b8a8-f1e9c8645928" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-53c46a71-65b4-432e-b8a8-f1e9c8645928" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Deleting offline snapshot 53c46a71-65b4-432e-b8a8-f1e9c8645928 of volume 0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] snapshot_file for this snap is: volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb89a6-552e-42a9-9d70-ff93dcbc47ee]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "cinder-5e2f5dc1-98f1-4d27-9a63-39a94edd92df-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "cinder-5e2f5dc1-98f1-4d27-9a63-39a94edd92df-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "cinder-quobyte-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "cinder-quobyte-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:44 devstack sudo[84766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 Apr 08 17:38:44 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366da2e-93b9-4f5a-9bdd-cbd2c079c389]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:44 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df Apr 08 17:38:44 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:44 devstack sudo[84748]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 1073741824" returned: 0 in 0.672s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:44 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 Apr 08 17:38:44 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:45 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928" returned: 0 in 0.577s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a582a9b-eaa8-49aa-99fa-d57e94ffb079]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:45 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" returned: 0 in 0.511s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:45 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 Apr 08 17:38:45 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:45 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df Apr 08 17:38:45 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:45 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122" returned: 0 in 0.426s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397cf2ee-70b1-4363-bf59-0d8577200551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d7666b-8584-4eef-8f18-0b6a2dcce569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:45 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Volume volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 (d63f4171-1c19-4ac2-aea3-723c2d1b9122): created successfully Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d7666b-8584-4eef-8f18-0b6a2dcce569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Flow 'volume_create_manager' (b3eb93fa-8677-440c-a15b-71a399f6056e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-17c0148b-c6c6-4dd2-92dd-f6957cb78425 tempest-SnapshotMetadataTestJSON-509470952 None] Created volume successfully. Apr 08 17:38:45 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:45 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "cinder-quobyte-5e2f5dc1-98f1-4d27-9a63-39a94edd92df" released by "delete_volume" :: held 0.967s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:45 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 Apr 08 17:38:45 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Created reservations ['d8b4766b-ae82-406d-8049-7169fea96e5f', '3b157b65-6667-4751-9a9c-de1c0cceddcc', '1f81d1af-97b6-4f12-b1f7-b38697bae8fb', '571e138e-86c0-4469-b54e-747457cf8f3a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:45 devstack sudo[84797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:45 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:46 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:46 devstack sudo[84803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928 Apr 08 17:38:46 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:46 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.522s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Deleted volume successfully. Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19017a24-4c86-4373-9d1c-234074de78a2 tempest-DeleteServersTestJSON-2020937988 None] Lock "cinder-5e2f5dc1-98f1-4d27-9a63-39a94edd92df-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Creating offline snapshot 4b935c44-f887-4b55-9934-376dfaf72085 of volume d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c7d5db-a602-4f45-bfcb-29d01a413e28]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:46 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 Apr 08 17:38:46 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:46 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2.53c46a71-65b4-432e-b8a8-f1e9c8645928" returned: 0 in 0.525s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-53c46a71-65b4-432e-b8a8-f1e9c8645928" released by "_delete_snapshot" :: held 2.152s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" released by "delete_snapshot" :: held 2.170s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Created reservations ['c98fdc4f-50f1-4135-929c-4c58700b5fba', '6b60ad1f-a5d9-44cf-bf9a-b2279325890f', 'fdf5b5a6-4b5f-4377-9eee-137896ba7d74', '5d41daf8-ad7f-427c-943b-9a81fc160ec6'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Delete snapshot completed successfully. Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b39eca56-a4c7-451d-b357-36166dc18cf4 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-53c46a71-65b4-432e-b8a8-f1e9c8645928-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:46 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:46 devstack sudo[84845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 1G Apr 08 17:38:46 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:47 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 1G" returned: 0 in 0.546s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:47 devstack sudo[84854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 Apr 08 17:38:47 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "cinder-0376ede4-6987-4aa1-b492-c8cd887a7fb2-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-0376ede4-6987-4aa1-b492-c8cd887a7fb2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" acquired by "delete_volume" :: waited 0.028s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bda5c-2598-4067-83c6-dbed5903fb27]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:47 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 Apr 08 17:38:47 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:48 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085" returned: 0 in 0.532s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:48 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 is being set with open permissions: ugo+rw Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:48 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 Apr 08 17:38:48 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:48 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2" returned: 0 in 0.554s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:48 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2 Apr 08 17:38:48 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:48 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085" returned: 0 in 0.453s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:48 devstack sudo[84870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info Apr 08 17:38:48 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:48 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0376ede4-6987-4aa1-b492-c8cd887a7fb2" returned: 0 in 0.528s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-quobyte-0376ede4-6987-4aa1-b492-c8cd887a7fb2" released by "delete_volume" :: held 1.115s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:48 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Created reservations ['d5ad8fa9-6d79-463f-933b-a2eef6b63d94', '2993fe7d-1a88-4e66-8041-c2af9249b01f', '9b961a47-b752-4345-8b0c-418dfd89b570', 'd86475c5-825e-470c-893f-9f4ede0cec4c'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:49 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:49 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:49 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info" returned: 0 in 0.624s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:49 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info is being set with open permissions: ugo+rw Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:49 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info Apr 08 17:38:49 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:49 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.631s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Deleted volume successfully. Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-69c06850-b3a8-4990-b5ae-08cffc767e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-410159396 None] Lock "cinder-0376ede4-6987-4aa1-b492-c8cd887a7fb2-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:49 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.info" returned: 0 in 0.779s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.554s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-778ddfb8-b2d7-4fb1-86cf-91439ee46d56 tempest-SnapshotMetadataTestJSON-509470952 None] Create snapshot completed successfully Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "cinder-4b935c44-f887-4b55-9934-376dfaf72085-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-4b935c44-f887-4b55-9934-376dfaf72085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "cinder-quobyte-4b935c44-f887-4b55-9934-376dfaf72085" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-4b935c44-f887-4b55-9934-376dfaf72085" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Deleting offline snapshot 4b935c44-f887-4b55-9934-376dfaf72085 of volume d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] snapshot_file for this snap is: volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b26a3c-3582-4e0a-8e72-9f75af2b5547]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:51 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 Apr 08 17:38:51 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Flow 'volume_create_manager' (5ab28028-9c74-4327-b673-2a0cbf625603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922a556-71eb-4462-afef-20c91cb2d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3922a556-71eb-4462-afef-20c91cb2d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-694157916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96388ee-9111-4ea6-b9e1-da0f9a79342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e9808143c4ea4bf9ed73c7feae881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:52Z,use_quota=True,user_id='153b5df9b44e41138cacf093688d76a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78594299-8ad1-4a92-a48b-6a606dc6d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78594299-8ad1-4a92-a48b-6a606dc6d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f016d898-22ca-4f20-a4ab-5c939d86d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f016d898-22ca-4f20-a4ab-5c939d86d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96388ee-9111-4ea6-b9e1-da0f9a79342c', 'volume_name': 'volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18602d86-4ae6-4564-965a-9bba5cc928bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18602d86-4ae6-4564-965a-9bba5cc928bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae4923-b605-470b-853e-a6929422c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:51 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Volume e96388ee-9111-4ea6-b9e1-da0f9a79342c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c', 'volume_size': 1} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-694157916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96388ee-9111-4ea6-b9e1-da0f9a79342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e9808143c4ea4bf9ed73c7feae881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:52Z,use_quota=True,user_id='153b5df9b44e41138cacf093688d76a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Creating volume e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:51 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:51 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c 1073741824 Apr 08 17:38:51 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:52 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085" returned: 0 in 0.904s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758ee47-3dee-4441-a20d-c8f82df60968]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:52 devstack sudo[84919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 Apr 08 17:38:52 devstack sudo[84919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:52 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c 1073741824" returned: 0 in 0.657s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:52 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c Apr 08 17:38:52 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:52 devstack sudo[84919]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122" returned: 0 in 0.610s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:52 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 Apr 08 17:38:52 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:53 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae4923-b605-470b-853e-a6929422c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc13b9d7-5d20-43bc-8f08-9f0f11087b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:53 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Volume volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c (e96388ee-9111-4ea6-b9e1-da0f9a79342c): created successfully Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc13b9d7-5d20-43bc-8f08-9f0f11087b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Flow 'volume_create_manager' (5ab28028-9c74-4327-b673-2a0cbf625603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-1a70a3cc-22a0-4544-b531-8aeedb771015 req-8363d3c3-8eff-485d-bce1-883ae5ef7255 tempest-VolumesSnapshotsTestJSON-1620826408 None] Created volume successfully. Apr 08 17:38:53 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085" returned: 0 in 0.540s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:53 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085 Apr 08 17:38:53 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:53 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122.4b935c44-f887-4b55-9934-376dfaf72085" returned: 0 in 0.452s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-4b935c44-f887-4b55-9934-376dfaf72085" released by "_delete_snapshot" :: held 2.589s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" released by "delete_snapshot" :: held 2.605s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:53 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Created reservations ['7b67c7e2-02c2-4eae-8ad2-52ecac20ad9f', 'de40d40e-c1ed-4068-8725-87dd1f1007d6', '261bd285-d031-4c0c-b0e3-447d8dbe8e93', '0bcda5e7-0800-4d71-9c86-5c3f8cadd1b6'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:54 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Delete snapshot completed successfully. Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fc18e187-d345-4156-a64d-97f1cf1658cb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-4b935c44-f887-4b55-9934-376dfaf72085-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (744a9214-bd42-445e-bfcd-67526228bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e9642e-88ae-468b-9b1a-4326c5ef9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e9642e-88ae-468b-9b1a-4326c5ef9d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2140826043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee74783-f32a-4cab-94f6-1b526de548af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:54Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4514c0b7-75b2-42cd-a5f3-431a3dfc2b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4514c0b7-75b2-42cd-a5f3-431a3dfc2b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f882d21d-3e78-4a50-a429-3b6c6ff2fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f882d21d-3e78-4a50-a429-3b6c6ff2fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee74783-f32a-4cab-94f6-1b526de548af', 'volume_name': 'volume-fee74783-f32a-4cab-94f6-1b526de548af', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda26a26-8f87-4883-b310-f8368188b089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda26a26-8f87-4883-b310-f8368188b089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e26d93-69f5-4c4d-a1fc-2e96f6d907f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:54 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Volume fee74783-f32a-4cab-94f6-1b526de548af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee74783-f32a-4cab-94f6-1b526de548af', 'volume_size': 1} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2140826043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee74783-f32a-4cab-94f6-1b526de548af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:54Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Creating volume fee74783-f32a-4cab-94f6-1b526de548af {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:54 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:54 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af 1073741824 Apr 08 17:38:54 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "cinder-d63f4171-1c19-4ac2-aea3-723c2d1b9122-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-d63f4171-1c19-4ac2-aea3-723c2d1b9122-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[080840c3-3976-432c-93ad-5c5d264ac566]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:54 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 Apr 08 17:38:54 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:54 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af 1073741824" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:54 devstack sudo[84948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af Apr 08 17:38:54 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:55 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:55 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122 Apr 08 17:38:55 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:55 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af" returned: 0 in 0.418s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e26d93-69f5-4c4d-a1fc-2e96f6d907f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee74783-f32a-4cab-94f6-1b526de548af', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be27e4c3-8936-49ec-896f-664c51545a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Creating offline snapshot 878fd9c3-72fe-4501-b6b9-f2410dcad562 of volume e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:38:55 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Volume volume-fee74783-f32a-4cab-94f6-1b526de548af (fee74783-f32a-4cab-94f6-1b526de548af): created successfully Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be27e4c3-8936-49ec-896f-664c51545a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (744a9214-bd42-445e-bfcd-67526228bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917988d-690e-4be9-9f43-8a64982d3d52]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-714b9adc-c04d-49b1-97f3-7cad9ebe2e67 tempest-VolumesListAdminTestJSON-2014959464 None] Created volume successfully. Apr 08 17:38:55 devstack sudo[84956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c Apr 08 17:38:55 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:55 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d63f4171-1c19-4ac2-aea3-723c2d1b9122" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-quobyte-d63f4171-1c19-4ac2-aea3-723c2d1b9122" released by "delete_volume" :: held 0.992s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Created reservations ['7f5a33e0-3be8-4b4a-b21a-28a783b5b0ce', 'a8ba1536-656f-42bd-af12-9651fb3dd6a1', '4aab1bf0-90e7-4bb5-8f5c-267d4b3b5fba', 'f712581d-f5f3-4db2-90cb-c32c2890578d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:55 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:38:55 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:56 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c" returned: 0 in 0.658s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:56 devstack sudo[84988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 1G Apr 08 17:38:56 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:56 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.577s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:38:56 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Deleted volume successfully. Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d4ddce1f-0e72-47e1-8e90-5b874ca86bbb tempest-SnapshotMetadataTestJSON-509470952 None] Lock "cinder-d63f4171-1c19-4ac2-aea3-723c2d1b9122-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:38:56 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 1G" returned: 0 in 0.774s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (4fb39f81-7f86-4ad7-88a6-8154cffc781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4297e-b271-4541-96e3-21324fb67178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:56 devstack sudo[84994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 Apr 08 17:38:56 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e4297e-b271-4541-96e3-21324fb67178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-746862941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b5a8bc-b34f-4b69-b234-a155d7ff5b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:57Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ceaf56-482e-4b5a-96de-88e5066930b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ceaf56-482e-4b5a-96de-88e5066930b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b8cc9e-c42a-4fe4-a41c-e558bbc79a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b8cc9e-c42a-4fe4-a41c-e558bbc79a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b5a8bc-b34f-4b69-b234-a155d7ff5b4f', 'volume_name': 'volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a4ee6-2f6c-4795-9cc1-6a5ad1633a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665a4ee6-2f6c-4795-9cc1-6a5ad1633a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a357bbae-6f32-4fe0-b30d-5ed401512a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:56 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Volume 27b5a8bc-b34f-4b69-b234-a155d7ff5b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f', 'volume_size': 1} Apr 08 17:38:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:57 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562" returned: 0 in 0.691s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:57 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 is being set with open permissions: ugo+rw Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:57 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 Apr 08 17:38:57 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (26543f79-cd41-4e4d-8a70-a5ab5ca46618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1c1ef-f54d-4af5-a7e1-efb6d9a9f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1c1ef-f54d-4af5-a7e1-efb6d9a9f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1528776015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89259d55-c2da-454f-a51f-f39c976b68d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28754140ca7b407f8814cca65236288f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:58Z,use_quota=True,user_id='776760077ba14ffab4101c4d7e994cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35182087-20ba-495c-ab0f-51c146ce2d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35182087-20ba-495c-ab0f-51c146ce2d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a13481-bd61-45e9-9245-b8e65a43512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a13481-bd61-45e9-9245-b8e65a43512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89259d55-c2da-454f-a51f-f39c976b68d9', 'volume_name': 'volume-89259d55-c2da-454f-a51f-f39c976b68d9', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af19618d-b029-4d35-b5c4-58cc5c416af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af19618d-b029-4d35-b5c4-58cc5c416af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e9a05-369d-4e39-b1df-954ec8886c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:38:57 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Volume 89259d55-c2da-454f-a51f-f39c976b68d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89259d55-c2da-454f-a51f-f39c976b68d9', 'volume_size': 1} Apr 08 17:38:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:58 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562" returned: 0 in 0.520s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:58 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info Apr 08 17:38:58 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:58 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:58 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info is being set with open permissions: ugo+rw Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:58 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info Apr 08 17:38:58 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:58 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.info" returned: 0 in 0.472s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.056s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-746862941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b5a8bc-b34f-4b69-b234-a155d7ff5b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:57Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Creating volume 27b5a8bc-b34f-4b69-b234-a155d7ff5b4f {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:38:58 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:38:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:58 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f 1073741824 Apr 08 17:38:58 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-c33c8c0a-1e99-4abe-aa1c-1c68f182c813 req-8d3760d2-8b3e-4d92-a220-b9491f3b7095 tempest-VolumesSnapshotsTestJSON-1620826408 None] Create snapshot completed successfully Apr 08 17:38:59 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 08 17:38:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f 1073741824" returned: 0 in 0.603s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:38:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:38:59 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f Apr 08 17:38:59 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:38:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "cinder-878fd9c3-72fe-4501-b6b9-f2410dcad562-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:38:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-878fd9c3-72fe-4501-b6b9-f2410dcad562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:38:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "cinder-quobyte-878fd9c3-72fe-4501-b6b9-f2410dcad562" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-878fd9c3-72fe-4501-b6b9-f2410dcad562" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Deleting offline snapshot 878fd9c3-72fe-4501-b6b9-f2410dcad562 of volume e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] snapshot_file for this snap is: volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c5ab2-72d6-45a4-a571-11c207140ae6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:00 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 Apr 08 17:39:00 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:00 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1528776015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89259d55-c2da-454f-a51f-f39c976b68d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28754140ca7b407f8814cca65236288f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:38:58Z,use_quota=True,user_id='776760077ba14ffab4101c4d7e994cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Creating volume 89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:00 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a357bbae-6f32-4fe0-b30d-5ed401512a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e169aa3f-9154-428e-b931-b6f19610fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:00 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 1073741824 Apr 08 17:39:00 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:00 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Volume volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f (27b5a8bc-b34f-4b69-b234-a155d7ff5b4f): created successfully Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e169aa3f-9154-428e-b931-b6f19610fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (4fb39f81-7f86-4ad7-88a6-8154cffc781f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1665b789-d624-4ffb-bb27-5c739ce238aa tempest-VolumesListAdminTestJSON-2014959464 None] Created volume successfully. Apr 08 17:39:00 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562" returned: 0 in 0.584s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe8569-7adc-41b4-a60f-4296d4832152]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:00 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 1073741824" returned: 0 in 0.509s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:00 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 Apr 08 17:39:00 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:00 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c Apr 08 17:39:00 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:01 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9" returned: 0 in 0.517s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e9a05-369d-4e39-b1df-954ec8886c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89259d55-c2da-454f-a51f-f39c976b68d9', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f56f203-f80c-4139-b86b-e64056aa5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c" returned: 0 in 0.576s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Volume volume-89259d55-c2da-454f-a51f-f39c976b68d9 (89259d55-c2da-454f-a51f-f39c976b68d9): created successfully Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f56f203-f80c-4139-b86b-e64056aa5113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 Apr 08 17:39:01 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (26543f79-cd41-4e4d-8a70-a5ab5ca46618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ecd18b03-d311-46dd-b658-cb0d6913a6ba tempest-VolumesDeleteCascade-1700631984 None] Created volume successfully. Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (643b1b6b-0a4a-4585-95ae-50c53f01dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfcf9e2-78e3-4929-90c3-c3b0e5d93c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfcf9e2-78e3-4929-90c3-c3b0e5d93c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-405520003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701b0297-7c30-4d2b-9d9b-a748e2a24068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:01Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f523084-4c59-47b2-95f7-803a75bd301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f523084-4c59-47b2-95f7-803a75bd301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0faf524-f0c6-4294-bfd9-6d2a0f0ec47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0faf524-f0c6-4294-bfd9-6d2a0f0ec47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701b0297-7c30-4d2b-9d9b-a748e2a24068', 'volume_name': 'volume-701b0297-7c30-4d2b-9d9b-a748e2a24068', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346334d3-b776-4d58-834e-ed88300af5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346334d3-b776-4d58-834e-ed88300af5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5b089a-e78b-4aae-8aa1-ad88c75aca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Volume 701b0297-7c30-4d2b-9d9b-a748e2a24068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701b0297-7c30-4d2b-9d9b-a748e2a24068', 'volume_size': 1} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-405520003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701b0297-7c30-4d2b-9d9b-a748e2a24068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa089218e254107a3d4e3c21b4d5772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:01Z,use_quota=True,user_id='44250c06aadf49b5ab4eb3c8ba532c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Creating volume 701b0297-7c30-4d2b-9d9b-a748e2a24068 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:01 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:01 devstack sudo[85042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 1073741824 Apr 08 17:39:01 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:01 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562" returned: 0 in 0.568s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:01 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562 Apr 08 17:39:01 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:02 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 1073741824" returned: 0 in 0.527s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:02 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 Apr 08 17:39:02 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:02 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c.878fd9c3-72fe-4501-b6b9-f2410dcad562" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-878fd9c3-72fe-4501-b6b9-f2410dcad562" released by "_delete_snapshot" :: held 2.242s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" released by "delete_snapshot" :: held 2.264s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.quota [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Created reservations ['d014fc27-d380-4dc8-abfa-c06aeb6264a6', '12ecfeeb-0210-40bc-bd2e-7f119e95444a', '1beeac5f-0edc-4cbc-99f9-fc9a29a28480', '1de47a16-d835-46d7-8a34-a016dd2337d7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Delete snapshot completed successfully. Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-776a057b-015c-431e-a084-49a12db2c613 req-b16d6888-c279-4376-a5a4-4b333edc6977 tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-878fd9c3-72fe-4501-b6b9-f2410dcad562-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:02 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068" returned: 0 in 0.487s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.194s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Creating offline snapshot d3ceaae5-be79-431d-8674-07e2768d029c of volume 89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5b089a-e78b-4aae-8aa1-ad88c75aca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701b0297-7c30-4d2b-9d9b-a748e2a24068', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b651d3b-e06e-45ea-a28d-f5025bd429c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41034ef-3659-4fdc-93c9-54921d02db0a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:02 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Volume volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 (701b0297-7c30-4d2b-9d9b-a748e2a24068): created successfully Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b651d3b-e06e-45ea-a28d-f5025bd429c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Flow 'volume_create_manager' (643b1b6b-0a4a-4585-95ae-50c53f01dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7650e539-7042-4c33-b8f1-3f3bd2690839 tempest-VolumesListAdminTestJSON-2014959464 None] Created volume successfully. Apr 08 17:39:02 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 Apr 08 17:39:02 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:02 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:02 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:03 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:03 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c 1G Apr 08 17:39:03 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "cinder-e96388ee-9111-4ea6-b9e1-da0f9a79342c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-e96388ee-9111-4ea6-b9e1-da0f9a79342c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" acquired by "delete_volume" :: waited 0.023s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4104304-5bf0-4200-a3b6-8b55f664e1b0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:03 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:03 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c Apr 08 17:39:03 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:03 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c 1G" returned: 0 in 0.614s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:03 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:03 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Flow 'volume_create_manager' (248b05b3-b42d-4eef-b7aa-f6497901ee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b42a1-5a06-4819-a338-459b516e5c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b42a1-5a06-4819-a338-459b516e5c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a36036-b6f6-4568-aad9-40a0f69de5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9d664db6174f0c8454ce5501019a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:04Z,use_quota=True,user_id='2122652f3e0c4cf6bafb4c2ecc2aa11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a274c-6387-4e71-a575-ca83173abda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a274c-6387-4e71-a575-ca83173abda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605b606-a502-4c5e-8161-2c65634ad84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6605b606-a502-4c5e-8161-2c65634ad84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a36036-b6f6-4568-aad9-40a0f69de5a5', 'volume_name': 'volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4978c0d-8c17-495e-98dc-bb681afd1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4978c0d-8c17-495e-98dc-bb681afd1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47946cc-d229-4c6b-a893-08e180a68a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Volume b0a36036-b6f6-4568-aad9-40a0f69de5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5', 'volume_size': 1} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:04 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c" returned: 0 in 0.802s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:04 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c Apr 08 17:39:04 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:04 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.534s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:04 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c is being set with open permissions: ugo+rw Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:04 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:04 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:04 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e96388ee-9111-4ea6-b9e1-da0f9a79342c" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-quobyte-e96388ee-9111-4ea6-b9e1-da0f9a79342c" released by "delete_volume" :: held 1.385s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.quota [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Created reservations ['7db3ee39-55a1-4b68-a2c2-08902a6a8acb', '02dc6bb8-394d-49fa-a02d-52b5b026ce28', '4735c919-a9ba-4a36-9584-c5b40a276ad6', 'cdaed9fd-c1d4-40c4-82de-5d0f72f5e70d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:04 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:04 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:04 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.571s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:04 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info Apr 08 17:39:04 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:05 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:05 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info is being set with open permissions: ugo+rw Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:05 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info Apr 08 17:39:05 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:05 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.566s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.manager [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Deleted volume successfully. Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-e29bf4e2-9a60-4755-9d11-05d432c07c87 req-8ab3b09e-724e-492a-b737-abd5307e33fa tempest-VolumesSnapshotsTestJSON-1620826408 None] Lock "cinder-e96388ee-9111-4ea6-b9e1-da0f9a79342c-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:05 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.info" returned: 0 in 0.612s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.376s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a36036-b6f6-4568-aad9-40a0f69de5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9d664db6174f0c8454ce5501019a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:04Z,use_quota=True,user_id='2122652f3e0c4cf6bafb4c2ecc2aa11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Creating volume b0a36036-b6f6-4568-aad9-40a0f69de5a5 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:05 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5c3cf1d5-9a38-413d-88da-b1b2a2006b51 tempest-VolumesDeleteCascade-1700631984 None] Create snapshot completed successfully Apr 08 17:39:06 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 1073741824 Apr 08 17:39:06 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Flow 'volume_create_manager' (20e8c400-9731-48d3-9b24-8c14606f994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319040c3-ebda-4d07-9488-6e949554fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319040c3-ebda-4d07-9488-6e949554fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:06Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193f84f5-0837-4893-a095-48ff990123c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f43231e3a4dfaaf1c83f3d5d559c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:06Z,use_quota=True,user_id='11773fa018b14e25ae88c904f13250cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f291cf-88e6-425e-8d55-44d504ff0a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f291cf-88e6-425e-8d55-44d504ff0a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04c5055-5af0-4ec3-add5-30f10bfeabca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.image.glance [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Creating Keystone auth plugin from conf {{(pid=82664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04c5055-5af0-4ec3-add5-30f10bfeabca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '193f84f5-0837-4893-a095-48ff990123c0', 'volume_name': 'volume-193f84f5-0837-4893-a095-48ff990123c0', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c33295-3c56-4d71-a174-d046ef018721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c33295-3c56-4d71-a174-d046ef018721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b510e9-993d-4ce8-8f5a-d61f711d0456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume 193f84f5-0837-4893-a095-48ff990123c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-193f84f5-0837-4893-a095-48ff990123c0', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Trying to clone 193f84f5-0837-4893-a095-48ff990123c0 from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]). {{(pid=82664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 17:39:06 devstack cinder-volume[82664]: INFO cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Image download 20.69 MB at 20.69 MB/s Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e4cde-6e30-464d-8b5f-0165a95ef2fb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:06 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD Apr 08 17:39:06 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:06 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 1073741824" returned: 0 in 1.020s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:07 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 Apr 08 17:39:07 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:07 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 is fetched for user 11773fa018b14e25ae88c904f13250cb. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356632b-9bd5-4e8f-9b35-9975e3ce86cf]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:07 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5" returned: 0 in 0.598s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.728s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Creating offline snapshot 5b9782b4-29c9-4b23-bfb5-8600f7db7e26 of volume 89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47946cc-d229-4c6b-a893-08e180a68a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e96a949-a6af-4559-ab9f-ddfb474a3139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a738d-a926-40b6-b161-724f7780511e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Volume volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 (b0a36036-b6f6-4568-aad9-40a0f69de5a5): created successfully Apr 08 17:39:07 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD Apr 08 17:39:07 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e96a949-a6af-4559-ab9f-ddfb474a3139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Flow 'volume_create_manager' (248b05b3-b42d-4eef-b7aa-f6497901ee83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4d375819-bf2a-47eb-ab15-b6ba820cbb4c tempest-VolumesListAdminTestJSON-1332698428 None] Created volume successfully. Apr 08 17:39:07 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:07 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:08 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:08 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.792s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89259d55-c2da-454f-a51f-f39c976b68d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:08 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 1G Apr 08 17:39:08 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Acquiring lock "cinder-b0a36036-b6f6-4568-aad9-40a0f69de5a5-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "cinder-b0a36036-b6f6-4568-aad9-40a0f69de5a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Acquiring lock "cinder-quobyte-b0a36036-b6f6-4568-aad9-40a0f69de5a5" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "cinder-quobyte-b0a36036-b6f6-4568-aad9-40a0f69de5a5" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83b1725-3b2e-4b10-9ca4-ca3e999532b5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-701b0297-7c30-4d2b-9d9b-a748e2a24068-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-701b0297-7c30-4d2b-9d9b-a748e2a24068-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-quobyte-701b0297-7c30-4d2b-9d9b-a748e2a24068" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-701b0297-7c30-4d2b-9d9b-a748e2a24068" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb297027-37ff-4b67-95e5-827b5d95aa2c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:08 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 Apr 08 17:39:08 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:08 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 Apr 08 17:39:08 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 1G" returned: 0 in 0.607s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack sudo[85135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 Apr 08 17:39:09 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5" returned: 0 in 0.684s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068" returned: 0 in 0.606s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack sudo[85140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5 Apr 08 17:39:09 devstack sudo[85140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068 Apr 08 17:39:09 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-79273e46-abca-4f07-8799-3e47b33424a5 tempest-BackendsCapabilitiesAdminTestsJSON-757457198 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82664) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4ee206af-d3fd-4690-b89c-44cdbed3f281 tempest-BackendsCapabilitiesAdminTestsJSON-757457198 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82664) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 08 17:39:09 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26" returned: 0 in 0.535s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 is being set with open permissions: ugo+rw Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 Apr 08 17:39:09 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack sudo[85140]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b0a36036-b6f6-4568-aad9-40a0f69de5a5" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "cinder-quobyte-b0a36036-b6f6-4568-aad9-40a0f69de5a5" released by "delete_volume" :: held 1.142s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Created reservations ['e3b9ea9b-d788-4884-996d-dd57f95afd48', '39abc242-34c6-4f49-8c9e-5c1da370f099', '0ad504c0-cf4d-4b55-a370-2997521b20e0', '3ed3e58b-6091-4137-9ae6-2628b1b72054'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:09 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:09 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-701b0297-7c30-4d2b-9d9b-a748e2a24068" returned: 0 in 0.547s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-701b0297-7c30-4d2b-9d9b-a748e2a24068" released by "delete_volume" :: held 1.174s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Created reservations ['9a8e7785-072f-46c9-87ee-8ad154845d07', '11c57a34-3b39-445c-8c8c-0438e468118e', 'ad1be6f3-8c98-4247-a259-9e0aa536235a', 'e21a12ac-982b-4d8f-9f47-ccab9d8af830'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:09 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:09 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:10 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:06Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193f84f5-0837-4893-a095-48ff990123c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f43231e3a4dfaaf1c83f3d5d559c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:06Z,use_quota=True,user_id='11773fa018b14e25ae88c904f13250cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Creating volume 193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:10 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5494dcfd-a924-484b-a517-ed3df512b14e tempest-VolumesDeleteCascade-1700631984 None] Create snapshot completed successfully Apr 08 17:39:10 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1073741824 Apr 08 17:39:10 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:10 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Deleted volume successfully. Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a7aa51bc-11ad-485b-bba7-47e6be7c661c tempest-VolumesListAdminTestJSON-1332698428 None] Lock "cinder-b0a36036-b6f6-4568-aad9-40a0f69de5a5-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:10 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.627s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Deleted volume successfully. Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5ae1a53c-4a30-47d0-a7a5-c3963147ea0e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-701b0297-7c30-4d2b-9d9b-a748e2a24068-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:10 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1073741824" returned: 0 in 0.618s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:10 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:10 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-quobyte-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b0bb9b-e6ee-42a0-8200-940b06622fc8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:11 devstack sudo[85176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f Apr 08 17:39:11 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-89259d55-c2da-454f-a51f-f39c976b68d9-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-89259d55-c2da-454f-a51f-f39c976b68d9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Performing cascade delete. {{(pid=82664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-5b9782b4-29c9-4b23-bfb5-8600f7db7e26-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-5b9782b4-29c9-4b23-bfb5-8600f7db7e26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-5b9782b4-29c9-4b23-bfb5-8600f7db7e26" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-5b9782b4-29c9-4b23-bfb5-8600f7db7e26" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Deleting offline snapshot 5b9782b4-29c9-4b23-bfb5-8600f7db7e26 of volume 89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] snapshot_file for this snap is: volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[995a56ec-6947-40a5-8b62-69bf879a7607]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:11 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 Apr 08 17:39:11 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:11 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 0.800s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Attempting download of 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 193f84f5-0837-4893-a095-48ff990123c0. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 17:39:11 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" returned: 0 in 0.673s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:11 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f Apr 08 17:39:11 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cb44e-1730-4c6a-b7f5-4f08c3320e8a]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:11 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep Apr 08 17:39:11 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:12 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26" returned: 0 in 0.827s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89259d55-c2da-454f-a51f-f39c976b68d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b50984-9777-455e-b310-2b738477bc82]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:12 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:12 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:12 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" returned: 0 in 0.829s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f" released by "delete_volume" :: held 1.539s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Created reservations ['be8a732b-1cb2-40ca-a8a4-e8548a923f63', 'e47aebac-7c70-4a6a-93c8-9b8ada00d057', '741f664d-6d1f-4d07-8e06-92f4d040b8a5', '753ba2b4-5e28-4f2a-ba14-219069606df8'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:12 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep" returned: 0 in 0.869s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:12 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep Apr 08 17:39:12 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:12 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:12 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:12 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.907s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89259d55-c2da-454f-a51f-f39c976b68d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:13 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 Apr 08 17:39:13 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:13 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep" returned: 1 in 0.612s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_2vik15ep' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d66e76-821c-49ef-95ca-bd15f3f22973]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:13 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.666s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Deleted volume successfully. Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-fee74783-f32a-4cab-94f6-1b526de548af-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7e1357bc-9974-4681-883b-0a279391763e tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-27b5a8bc-b34f-4b69-b234-a155d7ff5b4f-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:13 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD Apr 08 17:39:13 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-fee74783-f32a-4cab-94f6-1b526de548af-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "cinder-quobyte-fee74783-f32a-4cab-94f6-1b526de548af" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-fee74783-f32a-4cab-94f6-1b526de548af" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6f0e3-e244-4391-8395-016b7e50239d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:13 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af Apr 08 17:39:13 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:13 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26" returned: 0 in 0.874s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:13 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26 Apr 08 17:39:13 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:14 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af" returned: 0 in 0.651s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:14 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af Apr 08 17:39:14 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:14 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD" returned: 0 in 1.042s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 was qcow2, converting to raw {{(pid=82664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:14 devstack sudo[85232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:14 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d73a418f-2076-44f8-8bc1-13f00066dac6 tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-377378036: creating Apr 08 17:39:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d73a418f-2076-44f8-8bc1-13f00066dac6 tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-377378036: created successfully Apr 08 17:39:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d73a418f-2076-44f8-8bc1-13f00066dac6 tempest-GroupSnapshotsTest-1868945976 None] Create group completed successfully. Apr 08 17:39:14 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.5b9782b4-29c9-4b23-bfb5-8600f7db7e26" returned: 0 in 0.705s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-5b9782b4-29c9-4b23-bfb5-8600f7db7e26" released by "_delete_snapshot" :: held 3.362s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" released by "delete_snapshot" :: held 3.379s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:14 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fee74783-f32a-4cab-94f6-1b526de548af" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-quobyte-fee74783-f32a-4cab-94f6-1b526de548af" released by "delete_volume" :: held 1.219s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['d1cd9e26-7709-473c-8a25-5064a2488cc1', '36298bba-e9c2-4e32-b812-01c43cb101da', 'c7ab194f-25a1-459b-b117-0d8874b20637', '03a33848-719c-4753-95c4-befa6d7ca799'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Created reservations ['69dadfeb-7296-44e4-a6eb-d6b53e775394', 'cdc75615-513a-4b86-a7c0-43f648e9272b', 'f5faec7e-a759-42e8-9c74-4e5e84ea87fa', 'c972fae3-1fc3-4205-9886-92b24884f3ee'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Delete snapshot completed successfully. Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-5b9782b4-29c9-4b23-bfb5-8600f7db7e26-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-d3ceaae5-be79-431d-8674-07e2768d029c-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-d3ceaae5-be79-431d-8674-07e2768d029c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-d3ceaae5-be79-431d-8674-07e2768d029c" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-d3ceaae5-be79-431d-8674-07e2768d029c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Deleting offline snapshot d3ceaae5-be79-431d-8674-07e2768d029c of volume 89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:39:14 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:14 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] snapshot_file for this snap is: volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec3fc8-2a35-4d0c-9769-7d315f4d96f2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:14 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:14 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:15 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.521s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:15 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Deleted volume successfully. Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98016f77-0904-447f-8a7d-2f31a5fa3763 tempest-VolumesListAdminTestJSON-2014959464 None] Lock "cinder-fee74783-f32a-4cab-94f6-1b526de548af-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:15 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.623s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89259d55-c2da-454f-a51f-f39c976b68d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce610c8f-5521-47ee-8b43-445fb46c733f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:15 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 1.218s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_1pg0ut7odevstack@QuobyteHD, size 112.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:39:15 devstack cinder-volume[82664]: INFO cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Converted 112.00 MB image at 91.83 MB/s Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:15 devstack sudo[85251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1G Apr 08 17:39:15 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:15 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 Apr 08 17:39:15 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (24ba7563-92b1-421c-86ad-099de0f69ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf8cd8f-56d8-41f5-9890-a62d060c863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf8cd8f-56d8-41f5-9890-a62d060c863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0d859d4-4a86-4f00-be9b-8f779a662f9c,host='devstack@QuobyteHD#QuobyteHD',id=d9699875-69cb-443a-a326-ee09c06eed38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:16Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0ab065a-a9ef-4d1c-b388-2a2c479fc04d),volume_type_id=f0ab065a-a9ef-4d1c-b388-2a2c479fc04d)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a5686f-337a-4396-b229-325e4b22f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a5686f-337a-4396-b229-325e4b22f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b13321c-55a4-4c98-8bcd-ae16f955b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b13321c-55a4-4c98-8bcd-ae16f955b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9699875-69cb-443a-a326-ee09c06eed38', 'volume_name': 'volume-d9699875-69cb-443a-a326-ee09c06eed38', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102e75b1-5c83-4b13-a952-ca8785f4bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102e75b1-5c83-4b13-a952-ca8785f4bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651fe3b-2ce2-4ac0-a5cf-22a5cd88a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Volume d9699875-69cb-443a-a326-ee09c06eed38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9699875-69cb-443a-a326-ee09c06eed38', 'volume_size': 1} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0d859d4-4a86-4f00-be9b-8f779a662f9c,created_at=2026-04-08T15:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1255981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0d859d4-4a86-4f00-be9b-8f779a662f9c,host='devstack@QuobyteHD#QuobyteHD',id=d9699875-69cb-443a-a326-ee09c06eed38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:16Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0ab065a-a9ef-4d1c-b388-2a2c479fc04d),volume_type_id=f0ab065a-a9ef-4d1c-b388-2a2c479fc04d)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Creating volume d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:15 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:15 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 1073741824 Apr 08 17:39:15 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:16 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 1G" returned: 0 in 0.757s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69190e-99ac-4c32-bf3d-e4b6807758bf]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:16 devstack sudo[85259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:16 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:16 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9" returned: 0 in 1.013s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:16 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:16 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:16 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 1073741824" returned: 0 in 0.710s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:16 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:16 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:16 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 0.704s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:17 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:17 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:17 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.595s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651fe3b-2ce2-4ac0-a5cf-22a5cd88a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9699875-69cb-443a-a326-ee09c06eed38', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24448767-52ba-43fc-bf57-22e90fcf3cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:17 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Volume volume-d9699875-69cb-443a-a326-ee09c06eed38 (d9699875-69cb-443a-a326-ee09c06eed38): created successfully Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24448767-52ba-43fc-bf57-22e90fcf3cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (24ba7563-92b1-421c-86ad-099de0f69ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7064ba96-d899-4b67-b202-5c8156d93fb8 tempest-GroupSnapshotsTest-1868945976 None] Created volume successfully. Apr 08 17:39:17 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 1.058s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:17 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c Apr 08 17:39:17 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:17 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 1 in 0.813s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Downloaded image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 193f84f5-0837-4893-a095-48ff990123c0 successfully. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 for user 11773fa018b14e25ae88c904f13250cb is deleted. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Marking volume 193f84f5-0837-4893-a095-48ff990123c0 as bootable. {{(pid=82664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Copying metadata from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 to 193f84f5-0837-4893-a095-48ff990123c0. {{(pid=82664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Creating volume glance metadata for volume 193f84f5-0837-4893-a095-48ff990123c0 backed by image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b510e9-993d-4ce8-8f5a-d61f711d0456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193f84f5-0837-4893-a095-48ff990123c0', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909eeca2-cf30-4481-84de-b33ae117f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:17 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Volume volume-193f84f5-0837-4893-a095-48ff990123c0 (193f84f5-0837-4893-a095-48ff990123c0): created successfully Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909eeca2-cf30-4481-84de-b33ae117f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Flow 'volume_create_manager' (20e8c400-9731-48d3-9b24-8c14606f994b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-3d7daf61-2116-42f9-82b9-aee4ef4cf6a0 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Created volume successfully. Apr 08 17:39:17 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9.d3ceaae5-be79-431d-8674-07e2768d029c" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-d3ceaae5-be79-431d-8674-07e2768d029c" released by "_delete_snapshot" :: held 3.208s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" released by "delete_snapshot" :: held 3.220s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['22f1f0b7-bba1-4264-a74f-8d2f92fa2387', '272e8b4b-1bf9-47dd-9ac6-3b365e893148', '32c43006-7e95-4b41-a0e6-f3a60e2a4b7d', '496b8eac-352d-4199-82ab-7351a36c8264'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Delete snapshot completed successfully. Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-d3ceaae5-be79-431d-8674-07e2768d029c-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Snapshots deleted, issuing volume delete {{(pid=82664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" acquired by "delete_volume" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b259941-9c60-4b16-bf5b-1033f40c6c85]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:18 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 Apr 08 17:39:18 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] GroupSnapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: creating. Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Group snapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: creating. {{(pid=82664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Creating offline snapshot dca3c9bb-080a-4760-b435-c26aa7916974 of volume d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[837a0535-b8bb-4695-9692-5d5b99b4ab4a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:18 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9" returned: 0 in 0.635s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:18 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9 Apr 08 17:39:18 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:18 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:18 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:19 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89259d55-c2da-454f-a51f-f39c976b68d9" returned: 0 in 0.599s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-89259d55-c2da-454f-a51f-f39c976b68d9" released by "delete_volume" :: held 1.267s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['336f69fa-e7c8-48eb-8024-220766d954c7', '10a8b756-d330-4446-a6cf-673fc8adffe9', '5b489482-7094-4982-80bf-284b25587098', '5824a64d-e4c9-4c94-8d2c-dcda44b297e5'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:19 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.703s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:19 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 1G Apr 08 17:39:19 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:19 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:19 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:19 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Deleted volume successfully. Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75a4aefc-f67c-425c-80c6-00884cfc371d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-89259d55-c2da-454f-a51f-f39c976b68d9-delete_volume" released by "delete_volume" :: held 8.853s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:19 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 1G" returned: 0 in 0.565s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9699875-69cb-443a-a326-ee09c06eed38 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:19 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9699875-69cb-443a-a326-ee09c06eed38 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:19 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Flow 'volume_create_manager' (9a21a33d-5e75-4d96-8491-9071191cd254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872ccd69-0d7b-4b30-a51f-328cfc2f97e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872ccd69-0d7b-4b30-a51f-328cfc2f97e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574393912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f587eb-f517-4fb9-b092-5a9c95e43dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b532705313ff4fd7892f8725aec09c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:20Z,use_quota=True,user_id='d74dfe37b5644656b0b2043ebe7e9349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb6d32a-59e2-4816-8ff2-d4f085da2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb6d32a-59e2-4816-8ff2-d4f085da2049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2ea2c9-be0d-42f9-87c0-d5d07f33fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2ea2c9-be0d-42f9-87c0-d5d07f33fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f587eb-f517-4fb9-b092-5a9c95e43dc4', 'volume_name': 'volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e0d5bd-7c7c-453f-b91c-632640a6ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e0d5bd-7c7c-453f-b91c-632640a6ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1847815-810a-4271-b248-0752b28decb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Volume c0f587eb-f517-4fb9-b092-5a9c95e43dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4', 'volume_size': 1} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (7ae83baf-3379-4b30-a172-d420bd332cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebddd67-4985-4ec0-8b12-8b1cf7266609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebddd67-4985-4ec0-8b12-8b1cf7266609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092793638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8a2f6f-5577-4799-891d-0a1713badc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28754140ca7b407f8814cca65236288f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:21Z,use_quota=True,user_id='776760077ba14ffab4101c4d7e994cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1926cd30-cbdb-4dee-a704-9aafb3c2b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1926cd30-cbdb-4dee-a704-9aafb3c2b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c75085-8e5f-4072-b313-9713ed66f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c75085-8e5f-4072-b313-9713ed66f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8a2f6f-5577-4799-891d-0a1713badc91', 'volume_name': 'volume-cc8a2f6f-5577-4799-891d-0a1713badc91', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f11439-0690-46a6-abf5-4638514d78e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f11439-0690-46a6-abf5-4638514d78e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f72d8-07a8-4304-885e-5d0ceee43936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Volume cc8a2f6f-5577-4799-891d-0a1713badc91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8a2f6f-5577-4799-891d-0a1713badc91', 'volume_size': 1} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9699875-69cb-443a-a326-ee09c06eed38 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.651s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:20 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:20 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:20 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:21 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:21 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info Apr 08 17:39:21 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:21 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:21 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:21 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info Apr 08 17:39:21 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:21 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.info" returned: 0 in 0.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81742ce-c660-40b2-96ca-17aae5c22773]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:21 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-07811ef3-fcb8-4681-a54b-726ed842e177 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: created successfully Apr 08 17:39:21 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:21 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:22 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 0.465s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:22 devstack sudo[85333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:22 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:22 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 1 in 0.501s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.645s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574393912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f587eb-f517-4fb9-b092-5a9c95e43dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b532705313ff4fd7892f8725aec09c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:20Z,use_quota=True,user_id='d74dfe37b5644656b0b2043ebe7e9349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Creating volume c0f587eb-f517-4fb9-b092-5a9c95e43dc4 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:22 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:22 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 1073741824 Apr 08 17:39:22 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f', 'name': 'volume-193f84f5-0837-4893-a095-48ff990123c0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c556cc5-56c2-41ee-b7d9-afc9b757248b', 'enforce_multipath': True} {{(pid=82664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 08 17:39:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-16f292ae-77b2-4cb9-9fc8-86b74604b2f2 req-b94d823b-3861-4d1f-b262-3ba245bbe380 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] attachment_update completed successfully. Apr 08 17:39:23 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 1073741824" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:23 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 Apr 08 17:39:23 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:23 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" returned: 0 in 0.458s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092793638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8a2f6f-5577-4799-891d-0a1713badc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28754140ca7b407f8814cca65236288f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:21Z,use_quota=True,user_id='776760077ba14ffab4101c4d7e994cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Creating volume cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:23 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:23 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 1073741824 Apr 08 17:39:23 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1847815-810a-4271-b248-0752b28decb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a3f68-7101-4dc6-8751-1223d2f24279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:23 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Volume volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 (c0f587eb-f517-4fb9-b092-5a9c95e43dc4): created successfully Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a3f68-7101-4dc6-8751-1223d2f24279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Flow 'volume_create_manager' (9a21a33d-5e75-4d96-8491-9071191cd254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-49f26e60-0716-471b-b3ec-a9319c40dd75 tempest-VolumesTransfersTest-813297048 None] Created volume successfully. Apr 08 17:39:24 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 1073741824" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:24 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:24 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:24 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.126s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974-fb9b4310-25cc-48d2-90a7-303137497bba" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f72d8-07a8-4304-885e-5d0ceee43936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8a2f6f-5577-4799-891d-0a1713badc91', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb6544-e476-4b70-8909-6db3c34175c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974-fb9b4310-25cc-48d2-90a7-303137497bba" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Creating volume fb9b4310-25cc-48d2-90a7-303137497bba from snapshot dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:24 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Volume volume-cc8a2f6f-5577-4799-891d-0a1713badc91 (cc8a2f6f-5577-4799-891d-0a1713badc91): created successfully Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb6544-e476-4b70-8909-6db3c34175c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (7ae83baf-3379-4b30-a172-d420bd332cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8444d459-e179-4b8b-bb66-24b1f5d52a40 tempest-VolumesDeleteCascade-1700631984 None] Created volume successfully. Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] snapshot: dca3c9bb-080a-4760-b435-c26aa7916974, volume: fb9b4310-25cc-48d2-90a7-303137497bba, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=172,cinder:DELETE=14,cinder:SELECT=175,cinder:INSERT=57 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add7617-61e2-44b0-bc5d-2f5fafbf948d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cae73ab0-7e32-494e-86d5-ae81e51f931b tempest-VolumesTransfersTest-1547263145 None] Transfer volume completed successfully. Apr 08 17:39:25 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:25 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:25 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9699875-69cb-443a-a326-ee09c06eed38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af60770-d0c8-4238-a390-40f57acedcd1]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:25 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:25 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "cinder-c0f587eb-f517-4fb9-b092-5a9c95e43dc4-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-c0f587eb-f517-4fb9-b092-5a9c95e43dc4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=156,cinder:SELECT=141,cinder:INSERT=47,cinder:DELETE=15 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "cinder-quobyte-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-quobyte-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" acquired by "delete_volume" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c4697-352d-4ae5-b20b-e23f6fb703c0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:25 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 Apr 08 17:39:25 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:25 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.497s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:25 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba Apr 08 17:39:25 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:26 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:26 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4 Apr 08 17:39:26 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:27 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" returned: 0 in 0.706s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-quobyte-c0f587eb-f517-4fb9-b092-5a9c95e43dc4" released by "delete_volume" :: held 1.297s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Created reservations ['95320f1d-d3bc-4686-9ce2-75e356f36d23', '5a8693d8-d6fe-4b08-8e5f-44a5c4ba6fb9', '09fa32e8-6c72-4826-8951-7b2e1a1c2c00', '7498380c-133e-46da-b578-abe157bfa47d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:27 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:27 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:29 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba" returned: 0 in 3.098s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ecea7-b5c0-45e5-9adc-852ab2b045fb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:29 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:29 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:29 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Flow 'volume_create_manager' (47e01dfc-1983-4f45-a861-b8760712a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c33d95f-e296-442e-a96c-2342ece7845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.857s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Deleted volume successfully. Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c33d95f-e296-442e-a96c-2342ece7845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1008818661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9fa9f4-2c84-4520-b5f8-7f2ddd183064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b532705313ff4fd7892f8725aec09c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:29Z,use_quota=True,user_id='d74dfe37b5644656b0b2043ebe7e9349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca415d40-5bb4-4c0a-baa2-002279657a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca415d40-5bb4-4c0a-baa2-002279657a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2000055a-ad55-4309-be2e-5d0b4140b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2000055a-ad55-4309-be2e-5d0b4140b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9fa9f4-2c84-4520-b5f8-7f2ddd183064', 'volume_name': 'volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db09f684-1ed8-4f96-ae2e-e6dde04f1b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db09f684-1ed8-4f96-ae2e-e6dde04f1b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f256428d-0ffb-40c1-89df-5f697f38dc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:29 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Volume 2c9fa9f4-2c84-4520-b5f8-7f2ddd183064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064', 'volume_size': 1} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bebe3d7b-5708-4421-9cae-4082f0e0cded tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-c0f587eb-f517-4fb9-b092-5a9c95e43dc4-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:29 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.823s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38, size 1024.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:39:29 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Converted 1024.00 MB image at 330.35 MB/s Apr 08 17:39:29 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:29 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba Apr 08 17:39:29 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:30 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" released by "_copy_volume_from_snapshot" :: held 5.504s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974-fb9b4310-25cc-48d2-90a7-303137497bba" released by "_create_volume_from_snapshot" :: held 5.533s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.553s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.404s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Creating offline snapshot cf69c941-890b-4945-ab32-29bfbb3bb4c6 of volume cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c247667e-5512-40cb-a984-2bb75fb3926f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:30 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b659953c-98e7-4397-9740-eeb6d35c5071 tempest-GroupSnapshotsTest-1868945976 None] Create group from source-snapshot-651d9ba7-5152-45f1-88d2-cb50b17a9c63 completed successfully. Apr 08 17:39:30 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:30 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[70966066-9df6-40ce-97c6-e1c4ae177d3f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:30 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba Apr 08 17:39:30 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:31 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.670s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:31 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 1G Apr 08 17:39:31 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:31 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba" returned: 0 in 0.696s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:31 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba Apr 08 17:39:31 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:31 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 1G" returned: 0 in 0.610s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8a2f6f-5577-4799-891d-0a1713badc91 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:31 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8a2f6f-5577-4799-891d-0a1713badc91 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:31 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:32 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fb9b4310-25cc-48d2-90a7-303137497bba" returned: 0 in 0.516s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fb9b4310-25cc-48d2-90a7-303137497bba" released by "delete_volume" :: held 1.236s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['f6c5b24b-c12b-4a9b-94be-5bf2fbfa2f64'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:32 devstack cinder-volume[82664]: WARNING cinder.quota [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1515432629 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1515432629, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:39:32 devstack cinder-volume[82664]: WARNING cinder.quota [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1515432629 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1515432629, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['e54d3a66-8644-409f-9310-ededd4383322', '163e3a03-56e4-488e-9f7a-348ccb57419d', '8f40dc6b-4ea5-47eb-98da-b6d4128e4126', 'dae18f61-9dd6-4b0e-89d4-d09d276b777d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:32 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8a2f6f-5577-4799-891d-0a1713badc91 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.517s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:32 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 is being set with open permissions: ugo+rw Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:32 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:32 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:32 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:32 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:32 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.429s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:32 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:32 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info Apr 08 17:39:32 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:32 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:32 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a8456f1b-a310-41df-8ba6-acfd42de48a1 tempest-GroupSnapshotsTest-1868945976 None] Delete group completed successfully. Apr 08 17:39:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: deleting Apr 08 17:39:33 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info" returned: 0 in 0.561s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:33 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info is being set with open permissions: ugo+rw Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:33 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info Apr 08 17:39:33 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: deleting {{(pid=82664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Deleting offline snapshot dca3c9bb-080a-4760-b435-c26aa7916974 of volume d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] snapshot_file for this snap is: volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb0e3c0-feea-4937-ab10-ed1f82dbfd99]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:33 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:33 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:33 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.info" returned: 0 in 0.459s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.446s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1008818661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9fa9f4-2c84-4520-b5f8-7f2ddd183064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b532705313ff4fd7892f8725aec09c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:29Z,use_quota=True,user_id='d74dfe37b5644656b0b2043ebe7e9349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Creating volume 2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:33 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:33 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 1073741824 Apr 08 17:39:33 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e7c6f33c-8686-41a9-be3b-dd3471356d15 tempest-VolumesDeleteCascade-1700631984 None] Create snapshot completed successfully Apr 08 17:39:33 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9699875-69cb-443a-a326-ee09c06eed38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da24b7-d695-4349-8bfb-ce21bb9a93f8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:33 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:33 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:34 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 1073741824" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:34 devstack sudo[85490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 Apr 08 17:39:34 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:34 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.574s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:34 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:34 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (247fa3cf-efe2-4edc-8360-13f65aae445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303ed7cd-b0ba-46a0-8cc4-d041acc87607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303ed7cd-b0ba-46a0-8cc4-d041acc87607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1264217392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28754140ca7b407f8814cca65236288f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf69c941-890b-4945-ab32-29bfbb3bb4c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:35Z,use_quota=True,user_id='776760077ba14ffab4101c4d7e994cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2845eaf3-24cd-4212-a592-c12d2f76296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2845eaf3-24cd-4212-a592-c12d2f76296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b2e2ae-a012-49fd-a305-6c7997e82443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b2e2ae-a012-49fd-a305-6c7997e82443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc', 'volume_name': 'volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc', 'volume_size': 1, 'snapshot_id': 'cf69c941-890b-4945-ab32-29bfbb3bb4c6'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ffc61-19e2-424d-9fb8-5768826b9912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01ffc61-19e2-424d-9fb8-5768826b9912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c11e3-e296-4509-b5f3-707580102a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Volume 6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc', 'volume_size': 1, 'snapshot_id': 'cf69c941-890b-4945-ab32-29bfbb3bb4c6'} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" returned: 0 in 0.651s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Creating volume 6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc from snapshot cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f256428d-0ffb-40c1-89df-5f697f38dc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612e6bb5-86aa-40b7-b4b2-61f09972908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] snapshot: cf69c941-890b-4945-ab32-29bfbb3bb4c6, volume: 6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:39:34 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Volume volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 (2c9fa9f4-2c84-4520-b5f8-7f2ddd183064): created successfully Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612e6bb5-86aa-40b7-b4b2-61f09972908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Flow 'volume_create_manager' (47e01dfc-1983-4f45-a861-b8760712a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fd5a8c-101b-4cd8-a4c4-9dbc3d99f507]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1af28b0d-be19-4f74-b2eb-8297f7936467 tempest-VolumesTransfersTest-813297048 None] Created volume successfully. Apr 08 17:39:35 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.590s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:35 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:35 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:35 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974 Apr 08 17:39:35 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:35 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38.dca3c9bb-080a-4760-b435-c26aa7916974" returned: 0 in 0.539s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-dca3c9bb-080a-4760-b435-c26aa7916974" released by "_delete_snapshot" :: held 2.282s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" released by "delete_snapshot" :: held 2.296s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:35 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.629s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8a2f6f-5577-4799-891d-0a1713badc91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acdaa8e-bd1a-4217-97ac-5f9a4ee5ed23]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:35 devstack cinder-volume[82664]: WARNING cinder.quota [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1515432629 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1515432629, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['ff61a8a9-c809-4b89-b3d8-a86a38c04bf7', '9a75dd2f-eda2-4d90-a02e-a20265140c6c', 'a0a4bca9-5f47-455f-9531-9e4c767649a8', 'd2ea84da-18b2-4f1e-93a1-2fc8063cfacc'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:35 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:35 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-32199ef2-62c6-4abc-a198-34c920faa499 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 651d9ba7-5152-45f1-88d2-cb50b17a9c63: deleted successfully Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "cinder-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "cinder-quobyte-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-quobyte-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b19a5d-22cd-4eb1-867a-05f72261cd21]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:36 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 Apr 08 17:39:36 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:36 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.581s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:36 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc Apr 08 17:39:36 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:36 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" returned: 0 in 0.501s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:36 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064 Apr 08 17:39:36 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" acquired by "delete_volume" :: waited 0.028s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[301821c8-8466-41e0-935f-5abd58dc6b62]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:37 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:37 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:37 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" returned: 0 in 1.044s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-quobyte-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064" released by "delete_volume" :: held 1.586s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Created reservations ['2d0753ca-558d-4ccb-bc84-963d3612da0f', '42372f5d-4e46-418e-ba52-827ce5030c56', '7b834a3e-f0da-445e-bea5-dbd4b4b9d111', '68b39db7-d256-4d32-b49e-c3903067d115'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:37 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:37 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:38 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" returned: 0 in 2.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa98d0a1-5f71-4245-9571-b2993e613bbe]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:38 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 1.810s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:38 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38 Apr 08 17:39:38 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:38 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:38 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:38 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.229s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:38 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Deleted volume successfully. Apr 08 17:39:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-65cac323-fd63-4c9f-b782-52d48305dfba tempest-VolumesTransfersTest-1718229950 None] Lock "cinder-2c9fa9f4-2c84-4520-b5f8-7f2ddd183064-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:39 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d9699875-69cb-443a-a326-ee09c06eed38" returned: 0 in 0.560s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-d9699875-69cb-443a-a326-ee09c06eed38" released by "delete_volume" :: held 2.441s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['72160c08-c6cf-4622-97d6-5639bc7ff6f8'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:39 devstack cinder-volume[82664]: WARNING cinder.db.sqlalchemy.api [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1515432629'] Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['2877228a-09d1-4505-911a-5831266391a7', 'd2ba47ab-c6a6-424e-81e2-340904f651fa', 'd802851f-3d52-49c6-875b-eb83d4e7f987', '5731f407-199c-445b-9490-ab57a2f4b53d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:39 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.776s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:39:39 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Converted 1024.00 MB image at 407.33 MB/s Apr 08 17:39:39 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc is being set with open permissions: ugo+rw Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:39 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc Apr 08 17:39:39 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:39 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:39 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:39 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" returned: 0 in 0.463s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" released by "_copy_volume_from_snapshot" :: held 5.065s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" released by "_create_volume_from_snapshot" :: held 5.098s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.108s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c11e3-e296-4509-b5f3-707580102a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc', 'volume_size': 1, 'snapshot_id': 'cf69c941-890b-4945-ab32-29bfbb3bb4c6'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36216d4-1cfc-4bdf-a1ef-35dc5e1d0a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Volume volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc (6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc): created successfully Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36216d4-1cfc-4bdf-a1ef-35dc5e1d0a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Flow 'volume_create_manager' (247fa3cf-efe2-4edc-8360-13f65aae445a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:40 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.506s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-89369500-36c8-4281-92c5-da4a1e6a5174 tempest-GroupSnapshotsTest-1868945976 None] Delete group completed successfully. Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3e47ca97-59df-4b30-a4fe-4811c30b458d tempest-VolumesDeleteCascade-1700631984 None] Created volume successfully. Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-cc8a2f6f-5577-4799-891d-0a1713badc91-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-cc8a2f6f-5577-4799-891d-0a1713badc91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Performing cascade delete. {{(pid=82664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-cf69c941-890b-4945-ab32-29bfbb3bb4c6-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-cf69c941-890b-4945-ab32-29bfbb3bb4c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Deleting offline snapshot cf69c941-890b-4945-ab32-29bfbb3bb4c6 of volume cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] snapshot_file for this snap is: volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0398fd8-3419-4ce6-932e-9b26864ab5d6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:40 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:40 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-739d0f18-5afc-44ab-b1a2-4cda7adc058b tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-128357874: creating Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-739d0f18-5afc-44ab-b1a2-4cda7adc058b tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-128357874: created successfully Apr 08 17:39:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-739d0f18-5afc-44ab-b1a2-4cda7adc058b tempest-GroupSnapshotsTest-1868945976 None] Create group completed successfully. Apr 08 17:39:41 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.629s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8a2f6f-5577-4799-891d-0a1713badc91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b809fc65-4be7-46e2-a663-ff4f4952b4e8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:41 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:41 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:41 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.565s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:41 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:41 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (1f2c5e4d-2e87-442f-901c-e425820e6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0cca7-6a88-4fe3-adf7-f735624e6602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e0cca7-6a88-4fe3-adf7-f735624e6602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658255317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b372b94-deee-4d19-9118-6cd134268221,host='devstack@QuobyteHD#QuobyteHD',id=fd5c5c89-39c2-43e2-a3f8-45ccab0203f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:42Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(416ea767-013f-44ae-9e28-6dc21bd0c6df),volume_type_id=416ea767-013f-44ae-9e28-6dc21bd0c6df)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df155c4a-cf3c-4804-96c4-d715e661e460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df155c4a-cf3c-4804-96c4-d715e661e460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aa4706-0486-4e30-a853-b7bf2e69caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aa4706-0486-4e30-a853-b7bf2e69caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5c5c89-39c2-43e2-a3f8-45ccab0203f2', 'volume_name': 'volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dd1b12-f339-427d-aa78-d9c82397fa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dd1b12-f339-427d-aa78-d9c82397fa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135dd415-6923-4a27-9526-7cc28a638c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:42 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Volume fd5c5c89-39c2-43e2-a3f8-45ccab0203f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2', 'volume_size': 1} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b372b94-deee-4d19-9118-6cd134268221,created_at=2026-04-08T15:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658255317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b372b94-deee-4d19-9118-6cd134268221,host='devstack@QuobyteHD#QuobyteHD',id=fd5c5c89-39c2-43e2-a3f8-45ccab0203f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:42Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(416ea767-013f-44ae-9e28-6dc21bd0c6df),volume_type_id=416ea767-013f-44ae-9e28-6dc21bd0c6df)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Creating volume fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:42 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:42 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 1073741824 Apr 08 17:39:42 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:42 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.578s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:42 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6 Apr 08 17:39:42 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:42 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 1073741824" returned: 0 in 0.677s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:42 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 Apr 08 17:39:42 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:43 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91.cf69c941-890b-4945-ab32-29bfbb3bb4c6" returned: 0 in 0.741s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cf69c941-890b-4945-ab32-29bfbb3bb4c6" released by "_delete_snapshot" :: held 2.578s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" released by "delete_snapshot" :: held 2.601s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['1edacace-be24-41cd-ae1d-abf7e9cc553e', 'adea1954-744b-461a-a5bf-a9a6b01fb21f', '8adabe1e-0ee9-4caf-b813-142ad9e26a52', 'f81fb770-6381-4a02-abbc-19a9085fa441'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Delete snapshot completed successfully. Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-cf69c941-890b-4945-ab32-29bfbb3bb4c6-delete_snapshot" released by "delete_snapshot" :: held 2.747s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Snapshots deleted, issuing volume delete {{(pid=82664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01a1d7-0db7-4fa1-a588-259d467d15d6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:43 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:43 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:43 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" returned: 0 in 0.788s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135dd415-6923-4a27-9526-7cc28a638c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33803329-6432-4cbf-a63e-9d22dba31b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Volume volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 (fd5c5c89-39c2-43e2-a3f8-45ccab0203f2): created successfully Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33803329-6432-4cbf-a63e-9d22dba31b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (1f2c5e4d-2e87-442f-901c-e425820e6faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7df05de9-e8c3-48c5-b39f-daf51a8bdb78 tempest-GroupSnapshotsTest-1868945976 None] Created volume successfully. Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Flow 'volume_create_manager' (c4602b05-77bb-4323-bece-1ca6b01b0d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da702ae-8646-4fbd-a1d9-3239902f9fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da702ae-8646-4fbd-a1d9-3239902f9fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270307203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeb8715-2334-4175-8996-90acd9f90eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40e60ae7eb845308363a70321e5db6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:44Z,use_quota=True,user_id='ae635518302c4e7d898f7c8fd4edf566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d745ced-b692-40cc-9c5c-4b1358b43ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d745ced-b692-40cc-9c5c-4b1358b43ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1262c7-1f3e-45b6-8ee6-75de865a9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1262c7-1f3e-45b6-8ee6-75de865a9af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeeb8715-2334-4175-8996-90acd9f90eb0', 'volume_name': 'volume-aeeb8715-2334-4175-8996-90acd9f90eb0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0247ced5-3d25-4a06-860a-9f52439ea6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0247ced5-3d25-4a06-860a-9f52439ea6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df80bd2-3334-4850-9b75-ef9150a7b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Volume aeeb8715-2334-4175-8996-90acd9f90eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeeb8715-2334-4175-8996-90acd9f90eb0', 'volume_size': 1} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270307203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeeb8715-2334-4175-8996-90acd9f90eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40e60ae7eb845308363a70321e5db6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:44Z,use_quota=True,user_id='ae635518302c4e7d898f7c8fd4edf566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Creating volume aeeb8715-2334-4175-8996-90acd9f90eb0 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:44 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:44 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 1073741824 Apr 08 17:39:44 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:44 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.794s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:44 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91 Apr 08 17:39:44 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:44 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-cc8a2f6f-5577-4799-891d-0a1713badc91" returned: 0 in 0.479s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-cc8a2f6f-5577-4799-891d-0a1713badc91" released by "delete_volume" :: held 1.328s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['3af271ea-6df4-4a16-ae36-1668132b9703', 'a75c08b5-373e-4887-8ad7-92f558a9a253', 'daf42023-dab4-4be4-9f6b-36b640c6c910', 'a30eb5ca-2358-4e11-97ea-a503927d3928'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (e03953cc-a763-4181-b396-9c13cb87ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f88178b-e127-4a62-a5a2-11aee11a6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:44 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:44 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f88178b-e127-4a62-a5a2-11aee11a6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39306378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b372b94-deee-4d19-9118-6cd134268221,host='devstack@QuobyteHD#QuobyteHD',id=85bda638-e8af-433f-85e1-0a278e746056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:45Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(416ea767-013f-44ae-9e28-6dc21bd0c6df),volume_type_id=416ea767-013f-44ae-9e28-6dc21bd0c6df)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1302de08-3b70-43da-b319-ea45a65a22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1302de08-3b70-43da-b319-ea45a65a22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d051b30-7a04-4fc5-96e5-a965acd684ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d051b30-7a04-4fc5-96e5-a965acd684ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85bda638-e8af-433f-85e1-0a278e746056', 'volume_name': 'volume-85bda638-e8af-433f-85e1-0a278e746056', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3069c5d9-15da-4000-a06e-cfbf5dd61e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3069c5d9-15da-4000-a06e-cfbf5dd61e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0ab20-a493-4cbc-a3e6-4eb53b48c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Volume 85bda638-e8af-433f-85e1-0a278e746056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85bda638-e8af-433f-85e1-0a278e746056', 'volume_size': 1} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:44 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 1073741824" returned: 0 in 0.857s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:45 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 Apr 08 17:39:45 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[853eae46-1e6e-4d88-b970-c53730c86402]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:45 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc Apr 08 17:39:45 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:45 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.616s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Deleted volume successfully. Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cf4f4f12-4850-4438-af32-756bd13e3103 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-cc8a2f6f-5577-4799-891d-0a1713badc91-delete_volume" released by "delete_volume" :: held 4.918s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:45 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0" returned: 0 in 0.676s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b372b94-deee-4d19-9118-6cd134268221,created_at=2026-04-08T15:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39306378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b372b94-deee-4d19-9118-6cd134268221,host='devstack@QuobyteHD#QuobyteHD',id=85bda638-e8af-433f-85e1-0a278e746056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:45Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(416ea767-013f-44ae-9e28-6dc21bd0c6df),volume_type_id=416ea767-013f-44ae-9e28-6dc21bd0c6df)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Creating volume 85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:45 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df80bd2-3334-4850-9b75-ef9150a7b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeeb8715-2334-4175-8996-90acd9f90eb0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c854a3-2122-4897-ac07-a0bfe4074338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:45 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 1073741824 Apr 08 17:39:45 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:45 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Volume volume-aeeb8715-2334-4175-8996-90acd9f90eb0 (aeeb8715-2334-4175-8996-90acd9f90eb0): created successfully Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c854a3-2122-4897-ac07-a0bfe4074338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Flow 'volume_create_manager' (c4602b05-77bb-4323-bece-1ca6b01b0d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bc84d027-69be-4cfb-a37b-4bc862051c39 tempest-VolumesTransfersV355Test-1522810346 None] Created volume successfully. Apr 08 17:39:45 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" returned: 0 in 0.622s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:45 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc Apr 08 17:39:45 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:46 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 1073741824" returned: 0 in 0.584s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:46 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 Apr 08 17:39:46 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:46 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" returned: 0 in 0.529s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-quobyte-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc" released by "delete_volume" :: held 1.177s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Created reservations ['0e35173f-7c81-4494-bb6c-a88c95999f5a', '826232df-e4e0-43e5-bb03-d718834084e9', 'caf3b6fa-073a-436d-8643-4555f511c209', 'f68d4fea-2b5a-42c4-bc2b-ba113a7dff2a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:46 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:46 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-202036a8-905b-4118-a4ea-98d5abad911c tempest-VolumesTransfersV355Test-1317795905 None] Transfer volume completed successfully. Apr 08 17:39:46 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056" returned: 0 in 0.544s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a0ab20-a493-4cbc-a3e6-4eb53b48c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85bda638-e8af-433f-85e1-0a278e746056', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc1840-26fc-4f3c-ba94-d7a41e85647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:46 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Volume volume-85bda638-e8af-433f-85e1-0a278e746056 (85bda638-e8af-433f-85e1-0a278e746056): created successfully Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fc1840-26fc-4f3c-ba94-d7a41e85647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (e03953cc-a763-4181-b396-9c13cb87ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b42614fa-fbf7-4416-a081-5eb8f5047dad tempest-GroupSnapshotsTest-1868945976 None] Created volume successfully. Apr 08 17:39:47 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.719s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:47 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Deleted volume successfully. Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2bcbbfe2-3a9e-4b0d-96e7-3ec5b9955067 tempest-VolumesDeleteCascade-1700631984 None] Lock "cinder-6b7b80c4-e333-4ed9-8e2a-00bf0088a5dc-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "cinder-aeeb8715-2334-4175-8996-90acd9f90eb0-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-aeeb8715-2334-4175-8996-90acd9f90eb0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "cinder-quobyte-aeeb8715-2334-4175-8996-90acd9f90eb0" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-quobyte-aeeb8715-2334-4175-8996-90acd9f90eb0" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d6783d-b9c4-44f6-ae93-b1df17c58816]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:47 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 Apr 08 17:39:47 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-320ba854-bdb9-40e3-ab03-78c408929edd tempest-GroupSnapshotsTest-1868945976 None] Update group completed successfully. Apr 08 17:39:48 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0" returned: 0 in 0.736s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:48 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0 Apr 08 17:39:48 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:48 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-aeeb8715-2334-4175-8996-90acd9f90eb0" returned: 0 in 0.552s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-quobyte-aeeb8715-2334-4175-8996-90acd9f90eb0" released by "delete_volume" :: held 1.323s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:48 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Created reservations ['2f40e7b5-f8e0-47fc-8e37-5fc002fdec10', 'ed0ea870-43ee-43fd-9d8f-f926ccbfb304', 'd819b8b8-84e9-4857-b555-b0877cd7689d', '0b2bb89d-69c1-4840-bd2e-ef36d24c455d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:49 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:49 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d803df52-1756-41cc-93b0-a52ed0990c54 tempest-GroupSnapshotsTest-1868945976 None] Update group completed successfully. Apr 08 17:39:49 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.750s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Deleted volume successfully. Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eca401d9-1f2f-4a09-885d-5d2835ab752e tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-aeeb8715-2334-4175-8996-90acd9f90eb0-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Flow 'volume_create_manager' (435e8db8-0282-45d4-8e0f-33b34bedeaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28889e07-90ae-47ec-846b-fcd169b5a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28889e07-90ae-47ec-846b-fcd169b5a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-91770915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb81f4cc-2329-409b-86e1-8bf32aae58e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dee003346bd4366b619d753ba31883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:50Z,use_quota=True,user_id='2c644fdb407d4dd0bb989156616eb880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea62281-ccb2-4a78-be14-f3993dad760a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea62281-ccb2-4a78-be14-f3993dad760a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77e9a9-a928-46d2-863c-420d0b306da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77e9a9-a928-46d2-863c-420d0b306da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb81f4cc-2329-409b-86e1-8bf32aae58e4', 'volume_name': 'volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbe85a-a6a6-494c-a065-06a4fe4ae215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cbe85a-a6a6-494c-a065-06a4fe4ae215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547d1426-9f53-4009-8e35-63a2ba38b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Volume bb81f4cc-2329-409b-86e1-8bf32aae58e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4', 'volume_size': 1} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-91770915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb81f4cc-2329-409b-86e1-8bf32aae58e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dee003346bd4366b619d753ba31883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:50Z,use_quota=True,user_id='2c644fdb407d4dd0bb989156616eb880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Creating volume bb81f4cc-2329-409b-86e1-8bf32aae58e4 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:50 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:50 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 1073741824 Apr 08 17:39:50 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Flow 'volume_create_manager' (54720973-eb8e-4056-8a40-883a9c431d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae21d6-4e68-4bc8-8483-f675361d36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae21d6-4e68-4bc8-8483-f675361d36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1548790258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010c7613-e34f-466e-8bfb-6fbbc7486c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40e60ae7eb845308363a70321e5db6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:50Z,use_quota=True,user_id='ae635518302c4e7d898f7c8fd4edf566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce018a6f-fb27-4450-99ba-dd6f5e1cd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce018a6f-fb27-4450-99ba-dd6f5e1cd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe4433b-a16e-4863-80fa-064d93ac7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe4433b-a16e-4863-80fa-064d93ac7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010c7613-e34f-466e-8bfb-6fbbc7486c32', 'volume_name': 'volume-010c7613-e34f-466e-8bfb-6fbbc7486c32', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8036ec7c-2147-4bf6-a272-563ee555eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8036ec7c-2147-4bf6-a272-563ee555eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3dd6e-b063-4ca5-9cdb-8ac423b37927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:50 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Volume 010c7613-e34f-466e-8bfb-6fbbc7486c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010c7613-e34f-466e-8bfb-6fbbc7486c32', 'volume_size': 1} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:50 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:50 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3198e2be-23b5-4aff-a60b-5ceb0ef879d3 tempest-GroupSnapshotsTest-1868945976 None] Update group completed successfully. Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 1073741824" returned: 0 in 0.635s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:50 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 Apr 08 17:39:50 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:51 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4" returned: 0 in 0.570s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.109s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1548790258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010c7613-e34f-466e-8bfb-6fbbc7486c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40e60ae7eb845308363a70321e5db6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:50Z,use_quota=True,user_id='ae635518302c4e7d898f7c8fd4edf566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Creating volume 010c7613-e34f-466e-8bfb-6fbbc7486c32 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:39:51 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547d1426-9f53-4009-8e35-63a2ba38b519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfbd42-161b-4b2d-8bca-deb963b66ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:51 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 1073741824 Apr 08 17:39:51 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:51 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Volume volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 (bb81f4cc-2329-409b-86e1-8bf32aae58e4): created successfully Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfbd42-161b-4b2d-8bca-deb963b66ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Flow 'volume_create_manager' (435e8db8-0282-45d4-8e0f-33b34bedeaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:51 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c31f06d1-55bc-4a38-aa3a-4d8d0ddf7fbf tempest-VolumesMetadataTest-1389389102 None] Created volume successfully. Apr 08 17:39:51 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-97c6c378-3910-4c77-abb3-d32fea5e6651 tempest-GroupSnapshotsTest-1868945976 None] Update group completed successfully. Apr 08 17:39:51 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 1073741824" returned: 0 in 0.555s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:51 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 Apr 08 17:39:51 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:52 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32" returned: 0 in 0.654s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3dd6e-b063-4ca5-9cdb-8ac423b37927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010c7613-e34f-466e-8bfb-6fbbc7486c32', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a99bbb-b28e-421e-963c-b1adb2e0304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:52 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Volume volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 (010c7613-e34f-466e-8bfb-6fbbc7486c32): created successfully Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a99bbb-b28e-421e-963c-b1adb2e0304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Flow 'volume_create_manager' (54720973-eb8e-4056-8a40-883a9c431d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:52 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4bdd5ef4-34e1-49b2-ad37-7836f0846069 tempest-VolumesTransfersV355Test-1522810346 None] Created volume successfully. Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Acquiring lock "cinder-bb81f4cc-2329-409b-86e1-8bf32aae58e4-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "cinder-bb81f4cc-2329-409b-86e1-8bf32aae58e4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Acquiring lock "cinder-quobyte-bb81f4cc-2329-409b-86e1-8bf32aae58e4" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "cinder-quobyte-bb81f4cc-2329-409b-86e1-8bf32aae58e4" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[32397473-b0ab-4fac-b937-aabf5953abda]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:52 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 Apr 08 17:39:52 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] GroupSnapshot 85429b38-301d-49a7-ac47-75b6aa08b094: creating. Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Group snapshot 85429b38-301d-49a7-ac47-75b6aa08b094: creating. {{(pid=82664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Creating offline snapshot 7146ce78-ac93-49fa-ac2e-ed2c938ae491 of volume 85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[98639c4c-498f-4f44-ab58-b527515c4af0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:53 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 Apr 08 17:39:53 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:53 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4" returned: 0 in 0.558s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:53 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4 Apr 08 17:39:53 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "cinder-010c7613-e34f-466e-8bfb-6fbbc7486c32-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-010c7613-e34f-466e-8bfb-6fbbc7486c32-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "cinder-quobyte-010c7613-e34f-466e-8bfb-6fbbc7486c32" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-quobyte-010c7613-e34f-466e-8bfb-6fbbc7486c32" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3805c21-3819-417a-b575-8669c9f0aaf6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:53 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:53 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 Apr 08 17:39:53 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:53 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 1G Apr 08 17:39:53 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:53 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb81f4cc-2329-409b-86e1-8bf32aae58e4" returned: 0 in 0.621s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "cinder-quobyte-bb81f4cc-2329-409b-86e1-8bf32aae58e4" released by "delete_volume" :: held 1.206s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Created reservations ['f460d71e-d0dd-4996-8001-3d3569ef6b55', '53f181f7-b249-4485-bea8-a51e663d6fb8', 'b9a18009-f38d-4053-8e54-07cf79e11658', '91f7ca94-714a-4efe-946b-ddf0ebc6c2bc'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:54 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:54 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:54 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 1G" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85bda638-e8af-433f-85e1-0a278e746056 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:54 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32" returned: 0 in 0.649s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:54 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85bda638-e8af-433f-85e1-0a278e746056 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 Apr 08 17:39:54 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:54 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32 Apr 08 17:39:54 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:54 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.461s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:54 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Deleted volume successfully. Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1ac30c53-0c34-4401-9fc5-30bae9b2fbd1 tempest-VolumesMetadataTest-1389389102 None] Lock "cinder-bb81f4cc-2329-409b-86e1-8bf32aae58e4-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:54 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-010c7613-e34f-466e-8bfb-6fbbc7486c32" returned: 0 in 0.461s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-quobyte-010c7613-e34f-466e-8bfb-6fbbc7486c32" released by "delete_volume" :: held 1.150s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:54 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Created reservations ['eaae218d-e7ba-400f-97ea-198803d3b9e7', '4b19424a-bc96-47bf-aa6d-c5b35a0f7273', 'a306438f-34b0-4622-9705-accb86af0cbc', 'c7a3bc3e-070c-4ce2-9d3a-4256e8539daf'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85bda638-e8af-433f-85e1-0a278e746056 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491" returned: 0 in 0.510s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:54 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:54 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 Apr 08 17:39:54 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:54 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:54 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-19df7357-39c4-4cc4-b7c9-f88e30ec900e tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Terminate volume connection completed successfully. Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-19df7357-39c4-4cc4-b7c9-f88e30ec900e tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Deleting attachment 0c556cc5-56c2-41ee-b7d9-afc9b757248b. {{(pid=82664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 17:39:55 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.433s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Deleted volume successfully. Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-75cd98b2-e52e-4d69-acfe-4acb9265a207 tempest-VolumesTransfersV355Test-699133843 None] Lock "cinder-010c7613-e34f-466e-8bfb-6fbbc7486c32-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:55 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491" returned: 0 in 0.544s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:55 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info Apr 08 17:39:55 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "cinder-193f84f5-0837-4893-a095-48ff990123c0-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-193f84f5-0837-4893-a095-48ff990123c0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "cinder-quobyte-193f84f5-0837-4893-a095-48ff990123c0" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-quobyte-193f84f5-0837-4893-a095-48ff990123c0" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa4abd-e598-497f-bbac-1dfe4b5f2aa1]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:55 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:55 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:55 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info" returned: 0 in 0.565s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:55 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:55 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info Apr 08 17:39:55 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:56 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 0.660s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:56 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:56 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:56 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.info" returned: 0 in 0.711s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.520s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Creating offline snapshot cb0ea202-608f-43ac-8060-d5a9a5d599d9 of volume fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a39ed8-4f85-40e1-8ec2-2764ecd594ae]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:56 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 Apr 08 17:39:56 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:56 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 1 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:39:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:56 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0 Apr 08 17:39:56 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:57 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" returned: 0 in 0.776s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:57 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 1G Apr 08 17:39:57 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:57 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-193f84f5-0837-4893-a095-48ff990123c0" returned: 0 in 0.533s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-quobyte-193f84f5-0837-4893-a095-48ff990123c0" released by "delete_volume" :: held 1.818s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG cinder.quota [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Created reservations ['41c02719-1f6c-4132-a2ac-700c17c78745', '2afb05dd-fe88-4d4e-ae33-306bf7fb73fc', '41d82ca6-b1d6-4432-9ef5-34314c6cd40d', '9c82d1d8-3bd0-49b1-a57c-ed9567fa4901'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:39:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:57 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:39:57 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Flow 'volume_create_manager' (f327d9a4-07ec-4c02-9247-ced15b0ad87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bbe4a5-c592-497e-a232-816915b6a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bbe4a5-c592-497e-a232-816915b6a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1214386590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a6a6b6-2c8f-438d-9dce-cf17cca68463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141dbcf1fb3492f939d52621ccec5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:58Z,use_quota=True,user_id='28783b0cc6764bfba3d4e86e7cc0a4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2edd7f-80d4-425d-b285-39e6e431f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2edd7f-80d4-425d-b285-39e6e431f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b136c-9e9e-4cad-8de6-457812d31411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b136c-9e9e-4cad-8de6-457812d31411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a6a6b6-2c8f-438d-9dce-cf17cca68463', 'volume_name': 'volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8578e-92be-432b-aea2-adad805930a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95e8578e-92be-432b-aea2-adad805930a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:58 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b219fe8-a8c0-4c33-a925-afd9113a81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:58 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Volume 28a6a6b6-2c8f-438d-9dce-cf17cca68463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463', 'volume_size': 1} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 1G" returned: 0 in 0.681s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:58 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 Apr 08 17:39:58 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:58 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.586s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.manager [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:39:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Deleted volume successfully. Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-ffe5f4b2-495d-44c7-8a07-3fa62c0f2050 req-4be4c891-9bf7-4456-befb-0d1c13b88001 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-193f84f5-0837-4893-a095-48ff990123c0-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:39:58 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9" returned: 0 in 0.601s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:58 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:58 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 Apr 08 17:39:58 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:59 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:59 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info Apr 08 17:39:59 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:59 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info" returned: 0 in 0.422s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:39:59 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:39:59 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info Apr 08 17:39:59 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Flow 'volume_create_manager' (1f1bca6d-827c-4a74-b7bc-0aca3aaceaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6b8dd5-b512-4b45-9b2e-3e368cfa1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6b8dd5-b512-4b45-9b2e-3e368cfa1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-318475339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc95ef8d-9102-45b6-bfe0-0cf16244965b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a5b3a3f44f407dbdcaa0d551d3d928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:00Z,use_quota=True,user_id='7e31ee62dab94e91add77df4ad4b12b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fdfc6d-9624-4e30-8d8a-a9dbfb5d87ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fdfc6d-9624-4e30-8d8a-a9dbfb5d87ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74990d8-b8dd-467a-b709-2f9f83ad4469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74990d8-b8dd-467a-b709-2f9f83ad4469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc95ef8d-9102-45b6-bfe0-0cf16244965b', 'volume_name': 'volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b', 'volume_size': 2}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9834252a-fce1-4457-af4b-9329e894936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9834252a-fce1-4457-af4b-9329e894936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed33dd71-5b2f-4456-ad87-85c233e533a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:39:59 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Volume bc95ef8d-9102-45b6-bfe0-0cf16244965b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b', 'volume_size': 2} Apr 08 17:39:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:00 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.info" returned: 0 in 0.519s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.543s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.051s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1214386590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a6a6b6-2c8f-438d-9dce-cf17cca68463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141dbcf1fb3492f939d52621ccec5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:39:58Z,use_quota=True,user_id='28783b0cc6764bfba3d4e86e7cc0a4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Creating volume 28a6a6b6-2c8f-438d-9dce-cf17cca68463 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:00 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:00 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 1073741824 Apr 08 17:40:00 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0db57153-b5fe-4537-9738-19cf6d7af011 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 85429b38-301d-49a7-ac47-75b6aa08b094: created successfully Apr 08 17:40:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 85429b38-301d-49a7-ac47-75b6aa08b094: deleting Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 85429b38-301d-49a7-ac47-75b6aa08b094: deleting {{(pid=82664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-7146ce78-ac93-49fa-ac2e-ed2c938ae491" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-7146ce78-ac93-49fa-ac2e-ed2c938ae491" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Deleting offline snapshot 7146ce78-ac93-49fa-ac2e-ed2c938ae491 of volume 85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] snapshot_file for this snap is: volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd3581-e020-4734-888f-415ba2faf7c9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:00 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 Apr 08 17:40:00 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:00 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 1073741824" returned: 0 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:00 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 Apr 08 17:40:00 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:01 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491" returned: 0 in 0.501s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85bda638-e8af-433f-85e1-0a278e746056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffea0ed-9a68-44a1-9429-2699c951a281]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:01 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 Apr 08 17:40:01 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:01 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-318475339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc95ef8d-9102-45b6-bfe0-0cf16244965b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a5b3a3f44f407dbdcaa0d551d3d928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:00Z,use_quota=True,user_id='7e31ee62dab94e91add77df4ad4b12b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Creating volume bc95ef8d-9102-45b6-bfe0-0cf16244965b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:01 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b 2147483648 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:01 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b 2147483648 Apr 08 17:40:01 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b219fe8-a8c0-4c33-a925-afd9113a81b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ed209c-ab6a-484f-96dc-7f570394c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Volume volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 (28a6a6b6-2c8f-438d-9dce-cf17cca68463): created successfully Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ed209c-ab6a-484f-96dc-7f570394c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Flow 'volume_create_manager' (f327d9a4-07ec-4c02-9247-ced15b0ad87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-97d7d6a2-c50a-488b-9600-7fb9f1c4211b tempest-VolumesTransfersV357Test-1901591452 None] Created volume successfully. Apr 08 17:40:01 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056" returned: 0 in 0.557s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:01 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 Apr 08 17:40:01 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:01 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b 2147483648" returned: 0 in 0.579s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:01 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b Apr 08 17:40:01 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:02 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491" returned: 0 in 0.512s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:02 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491 Apr 08 17:40:02 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:02 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b" returned: 0 in 0.490s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed33dd71-5b2f-4456-ad87-85c233e533a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b', 'volume_size': 2}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bab0ca5-8ab4-46a8-84df-16dc5d326681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:02 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Volume volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b (bc95ef8d-9102-45b6-bfe0-0cf16244965b): created successfully Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bab0ca5-8ab4-46a8-84df-16dc5d326681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Flow 'volume_create_manager' (1f1bca6d-827c-4a74-b7bc-0aca3aaceaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-84af03fd-2607-4109-982f-6a0455f4a949 tempest-VolumesCloneNegativeTest-223973480 None] Created volume successfully. Apr 08 17:40:02 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056.7146ce78-ac93-49fa-ac2e-ed2c938ae491" returned: 0 in 0.415s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-7146ce78-ac93-49fa-ac2e-ed2c938ae491" released by "_delete_snapshot" :: held 2.038s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" released by "delete_snapshot" :: held 2.050s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-cb0ea202-608f-43ac-8060-d5a9a5d599d9" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-cb0ea202-608f-43ac-8060-d5a9a5d599d9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Deleting offline snapshot cb0ea202-608f-43ac-8060-d5a9a5d599d9 of volume fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] snapshot_file for this snap is: volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217f15e-c495-4406-9af4-f41696df4d0c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e2d79673-f84d-4a1d-9520-645ef265a72d tempest-VolumesTransfersV357Test-1099483315 None] Transfer volume completed successfully. Apr 08 17:40:02 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 Apr 08 17:40:02 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:02 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:02 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Acquiring lock "cinder-bc95ef8d-9102-45b6-bfe0-0cf16244965b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "cinder-bc95ef8d-9102-45b6-bfe0-0cf16244965b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Acquiring lock "cinder-quobyte-bc95ef8d-9102-45b6-bfe0-0cf16244965b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "cinder-quobyte-bc95ef8d-9102-45b6-bfe0-0cf16244965b" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[39299c72-3176-46f2-99d3-0f873f6534d1]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:03 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0903beb-80e4-4253-8c17-bbb9b11db8b9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:03 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b Apr 08 17:40:03 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:03 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 Apr 08 17:40:03 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:03 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "cinder-28a6a6b6-2c8f-438d-9dce-cf17cca68463-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-28a6a6b6-2c8f-438d-9dce-cf17cca68463-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "cinder-quobyte-28a6a6b6-2c8f-438d-9dce-cf17cca68463" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-quobyte-28a6a6b6-2c8f-438d-9dce-cf17cca68463" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29fd730-8c70-401b-aecc-7b75e00914e6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:03 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 Apr 08 17:40:03 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:03 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b" returned: 0 in 0.626s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:03 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b Apr 08 17:40:03 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:03 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" returned: 0 in 0.592s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:03 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 Apr 08 17:40:03 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:04 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463" returned: 0 in 0.506s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:04 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bc95ef8d-9102-45b6-bfe0-0cf16244965b" returned: 0 in 0.417s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463 Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "cinder-quobyte-bc95ef8d-9102-45b6-bfe0-0cf16244965b" released by "delete_volume" :: held 1.067s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:04 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Created reservations ['fbe86d67-d3d7-43de-bc03-40125e774806', 'b7637f62-9454-4d36-b07a-1f3bacb22392', 'ce394ef1-7118-4ff5-bb93-7989f781f804', 'a62e5157-4cf1-4772-8b28-8c3b8b945284'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:04 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:04 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9" returned: 0 in 0.517s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:04 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9 Apr 08 17:40:04 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:04 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-28a6a6b6-2c8f-438d-9dce-cf17cca68463" returned: 0 in 0.455s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-quobyte-28a6a6b6-2c8f-438d-9dce-cf17cca68463" released by "delete_volume" :: held 0.990s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Created reservations ['194e3889-6bfa-4757-8648-aa686d87ce55', 'd3f1bb41-c5c9-4c30-8189-569ced76262d', 'fa5c2fb2-f3b3-4e3e-a42b-092009db3023', '22a68c16-f357-4f3f-8a9d-90fd713c97af'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:04 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:04 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:04 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.449s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Deleted volume successfully. Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-374087d8-f715-4190-a08c-887e8583c9c7 tempest-VolumesCloneNegativeTest-223973480 None] Lock "cinder-bc95ef8d-9102-45b6-bfe0-0cf16244965b-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:04 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2.cb0ea202-608f-43ac-8060-d5a9a5d599d9" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-cb0ea202-608f-43ac-8060-d5a9a5d599d9" released by "_delete_snapshot" :: held 2.177s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" released by "delete_snapshot" :: held 2.187s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:04 devstack cinder-volume[82664]: WARNING cinder.quota [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1977328897 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1977328897, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:04 devstack cinder-volume[82664]: WARNING cinder.quota [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1977328897 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1977328897, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['45306fcc-62e0-496d-b7a0-64e3ff0bc7f7', '4905e5c2-169f-4f24-9fb3-21cd8f8ffb50', '314fe8c7-bf0b-4b31-9562-d132ee3372bf', '65843804-17c8-4beb-b70c-7d31ed7b1984'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['e43d62fe-1203-4a60-a456-ab7266d91754', '97032a6d-1f2b-4638-952f-6e20baa39316', '9db81ce7-aa0d-49e5-b82e-dff8c0010244', '39390e3f-25b2-445a-8d0f-4e771e4861db'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ad4da6b9-f596-4ad3-91a6-4b342e1fae87 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot 85429b38-301d-49a7-ac47-75b6aa08b094: deleted successfully Apr 08 17:40:05 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:05 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Deleted volume successfully. Apr 08 17:40:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e107d7db-89bd-46f0-aa0e-2739cbb3a33b tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-28a6a6b6-2c8f-438d-9dce-cf17cca68463-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Flow 'volume_create_manager' (6641567a-0616-4d16-a01b-a9a503b9fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8d00da-e7d1-4663-899e-7c5183e9e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8d00da-e7d1-4663-899e-7c5183e9e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1165703906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f4aec0-e76b-401f-8c23-4f21542e3e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141dbcf1fb3492f939d52621ccec5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:06Z,use_quota=True,user_id='28783b0cc6764bfba3d4e86e7cc0a4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68e6ad0-1762-4f27-a2a8-c2d645bf9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68e6ad0-1762-4f27-a2a8-c2d645bf9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b480cce-4685-43a5-ab3e-6458084bbb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b480cce-4685-43a5-ab3e-6458084bbb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f4aec0-e76b-401f-8c23-4f21542e3e8e', 'volume_name': 'volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd5a218-8f12-448c-a08e-f1d6736e1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd5a218-8f12-448c-a08e-f1d6736e1c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f4555-7e70-4cd9-99b4-426058989a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Volume 45f4aec0-e76b-401f-8c23-4f21542e3e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e', 'volume_size': 1} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1165703906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f4aec0-e76b-401f-8c23-4f21542e3e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5141dbcf1fb3492f939d52621ccec5d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:06Z,use_quota=True,user_id='28783b0cc6764bfba3d4e86e7cc0a4b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Creating volume 45f4aec0-e76b-401f-8c23-4f21542e3e8e {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:06 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:06 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e 1073741824 Apr 08 17:40:06 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0931773-6267-46f5-a43f-56ea80c15ce7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:06 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 Apr 08 17:40:06 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:06 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e 1073741824" returned: 0 in 0.609s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:06 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e Apr 08 17:40:06 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:06 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:06 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056 Apr 08 17:40:06 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Flow 'volume_create_manager' (3e5ea1da-82de-4bc4-b8bf-9c11ad569c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54cb14e-2675-4d41-a479-23dfed707761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54cb14e-2675-4d41-a479-23dfed707761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-959419668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27840abc-c507-4359-892b-aefa821dc0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e6517f9264e429bd60ad94a7bf1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:07Z,use_quota=True,user_id='3c1c58d5f9ba452c91ecf2a420659f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d6d30-22c9-4828-83d8-6c867f50155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d6d30-22c9-4828-83d8-6c867f50155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a1048b-f1a4-4621-ae85-71ceebfb8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.image.glance [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Creating Keystone auth plugin from conf {{(pid=82664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e" returned: 0 in 0.535s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f4555-7e70-4cd9-99b4-426058989a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c7b1b-7517-4753-9982-47a6931ec4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Volume volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e (45f4aec0-e76b-401f-8c23-4f21542e3e8e): created successfully Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c7b1b-7517-4753-9982-47a6931ec4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Flow 'volume_create_manager' (6641567a-0616-4d16-a01b-a9a503b9fabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c8d99600-c69f-4fa2-8d67-edf653fc7db4 tempest-VolumesTransfersV357Test-1901591452 None] Created volume successfully. Apr 08 17:40:07 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85bda638-e8af-433f-85e1-0a278e746056" returned: 0 in 0.606s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-85bda638-e8af-433f-85e1-0a278e746056" released by "delete_volume" :: held 1.237s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e77598-b169-4975-9e9d-35c70264022c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a1048b-f1a4-4621-ae85-71ceebfb8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27840abc-c507-4359-892b-aefa821dc0dd', 'volume_name': 'volume-27840abc-c507-4359-892b-aefa821dc0dd', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab79ed7-d2e6-440f-bd75-d5ebdbf3fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab79ed7-d2e6-440f-bd75-d5ebdbf3fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3019dedb-374a-4460-b655-94ad1dc0a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Volume 27840abc-c507-4359-892b-aefa821dc0dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27840abc-c507-4359-892b-aefa821dc0dd', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Trying to clone 27840abc-c507-4359-892b-aefa821dc0dd from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]). {{(pid=82664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 08 17:40:07 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 Apr 08 17:40:07 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 17:40:07 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Image download 20.69 MB at 20.69 MB/s Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c10f72-7fe5-440f-ac91-e75d31437e4c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:07 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD Apr 08 17:40:07 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:08 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" returned: 0 in 0.594s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:08 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2 Apr 08 17:40:08 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:08 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 is fetched for user 3c1c58d5f9ba452c91ecf2a420659f2c. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bfc032-f3f8-4724-99ec-a76ce84aa23a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "cinder-45f4aec0-e76b-401f-8c23-4f21542e3e8e-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-45f4aec0-e76b-401f-8c23-4f21542e3e8e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "cinder-quobyte-45f4aec0-e76b-401f-8c23-4f21542e3e8e" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-quobyte-45f4aec0-e76b-401f-8c23-4f21542e3e8e" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2645c4-3aee-4f81-aca2-387d03980d75]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:08 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD Apr 08 17:40:08 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:08 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e Apr 08 17:40:08 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:08 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" returned: 0 in 0.539s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-fd5c5c89-39c2-43e2-a3f8-45ccab0203f2" released by "delete_volume" :: held 1.181s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['5fd18b4b-314a-4e3f-a697-afdbda14d317'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:08 devstack cinder-volume[82664]: WARNING cinder.quota [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1977328897 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1977328897, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['6248be8d-a463-45a2-8483-235f65044b4e', '873668af-e2a8-48c6-bb19-e5a38f044c5b', '0dca3e35-7f07-4993-add0-861339927ffc', '8055a98f-1fc2-4429-a0ac-1d25c96d0a94'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['8ed4e974-3305-4b87-9fe7-1a30384d39cf', 'db59f3a1-06a2-47e9-8c12-54990e3b9451', '92b8eea8-c738-4c58-bba8-46ddc8c35c7a', 'abeb7ae9-8ab0-40fe-81de-31c90e79d71c'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:08 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:08 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:08 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-959419668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27840abc-c507-4359-892b-aefa821dc0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e6517f9264e429bd60ad94a7bf1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:07Z,use_quota=True,user_id='3c1c58d5f9ba452c91ecf2a420659f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Creating volume 27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:09 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1073741824 Apr 08 17:40:09 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:09 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e" returned: 0 in 0.609s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:09 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e Apr 08 17:40:09 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:09 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c2aef6db-e51e-4376-94e0-e4a7bfeda984 tempest-GroupSnapshotsTest-1868945976 None] Delete group completed successfully. Apr 08 17:40:09 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1073741824" returned: 0 in 0.528s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:09 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-45f4aec0-e76b-401f-8c23-4f21542e3e8e" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:09 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:09 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-quobyte-45f4aec0-e76b-401f-8c23-4f21542e3e8e" released by "delete_volume" :: held 1.106s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Created reservations ['01e75bb4-3211-4c48-ac8e-72f14016b3c9', '5ee5789d-d97a-4ec7-8f42-6a4e188ab9b3', '5ddd9f35-78b9-4f00-a062-0e2af1bbff85', 'e6eb0d04-6f13-4d4d-8e12-f93de4607544'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:09 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:09 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-0e6f9747-0af3-408e-ab4b-7ad42c1a06f4 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Terminate volume connection completed successfully. Apr 08 17:40:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-0e6f9747-0af3-408e-ab4b-7ad42c1a06f4 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Deleting attachment deba817c-23fa-4467-9b1c-d09026ca0134. {{(pid=82664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5540d498-4f14-435a-abdc-7ad2a7134b44 tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-236888448: creating Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5540d498-4f14-435a-abdc-7ad2a7134b44 tempest-GroupSnapshotsTest-1868945976 None] Group tempest-GroupSnapshotsTest-Group-236888448: created successfully Apr 08 17:40:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5540d498-4f14-435a-abdc-7ad2a7134b44 tempest-GroupSnapshotsTest-1868945976 None] Create group completed successfully. Apr 08 17:40:10 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Attempting download of 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 27840abc-c507-4359-892b-aefa821dc0dd. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8518397-fae5-4de8-97ed-3932b777fa22]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:10 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Deleted volume successfully. Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3e161e16-ca41-498b-89a7-d9682db36825 tempest-VolumesTransfersV357Test-1505468831 None] Lock "cinder-45f4aec0-e76b-401f-8c23-4f21542e3e8e-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:10 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7 Apr 08 17:40:10 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "cinder-df977523-99c5-46bd-aa5e-5d210e071a87-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-df977523-99c5-46bd-aa5e-5d210e071a87-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "cinder-quobyte-df977523-99c5-46bd-aa5e-5d210e071a87" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-quobyte-df977523-99c5-46bd-aa5e-5d210e071a87" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d835c-7990-4567-a866-a82fee3bd920]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:10 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:10 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 Apr 08 17:40:10 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:10 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7 Apr 08 17:40:10 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:11 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87" returned: 0 in 0.574s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:11 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87 Apr 08 17:40:11 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:11 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7" returned: 1 in 0.567s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237__ttwpkt7' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cd6d3-556e-4456-aea2-0b1062e315e7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:11 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD Apr 08 17:40:11 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (c66561c2-78f0-458b-b5b6-925a74ad356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ecce5-e79b-4bfa-b610-962590c4547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2ecce5-e79b-4bfa-b610-962590c4547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223124705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8adc2dd1-2c9f-49ac-b2fa-c95a02fec309,host='devstack@QuobyteHD#QuobyteHD',id=9c64c910-6046-4590-9fbf-93b1bf40e524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:11Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88d5411-df82-4ebc-8c6e-01e64c543407),volume_type_id=b88d5411-df82-4ebc-8c6e-01e64c543407)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b345af-db25-4d08-b23a-d9096de15b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b345af-db25-4d08-b23a-d9096de15b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73ff989-5e8b-4222-922b-add4b4240b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73ff989-5e8b-4222-922b-add4b4240b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c64c910-6046-4590-9fbf-93b1bf40e524', 'volume_name': 'volume-9c64c910-6046-4590-9fbf-93b1bf40e524', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32dad30-c79b-4528-930c-269288d9eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32dad30-c79b-4528-930c-269288d9eab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc9984-33cf-4adc-aa73-22f40b11e626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:11 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Volume 9c64c910-6046-4590-9fbf-93b1bf40e524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c64c910-6046-4590-9fbf-93b1bf40e524', 'volume_size': 1} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8adc2dd1-2c9f-49ac-b2fa-c95a02fec309,created_at=2026-04-08T15:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223124705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8adc2dd1-2c9f-49ac-b2fa-c95a02fec309,host='devstack@QuobyteHD#QuobyteHD',id=9c64c910-6046-4590-9fbf-93b1bf40e524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9280e33dc14805be05104d8713196a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:11Z,use_quota=True,user_id='5927b89b09ce4f7ab566a1bd8ec92859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b88d5411-df82-4ebc-8c6e-01e64c543407),volume_type_id=b88d5411-df82-4ebc-8c6e-01e64c543407)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Creating volume 9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:11 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:11 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 1073741824 Apr 08 17:40:11 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:11 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-df977523-99c5-46bd-aa5e-5d210e071a87" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-quobyte-df977523-99c5-46bd-aa5e-5d210e071a87" released by "delete_volume" :: held 1.190s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.quota [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Created reservations ['348dfcdc-0ec7-4fd4-9bbf-5cd2d69a961b', '71a6011e-7e1e-4169-9ec7-49eb834271ec', 'db9eef6b-3e0d-441c-93b0-ace4a9b6f3d1', '9ca14acb-c680-46cf-960b-c208d807fee0'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:11 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:11 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:11 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 was qcow2, converting to raw {{(pid=82664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 17:40:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:11 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:11 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:12 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 1073741824" returned: 0 in 0.675s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:12 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 Apr 08 17:40:12 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:12 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.608s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.manager [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Deleted volume successfully. Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [req-5f7b2624-e363-4fd3-a42e-e733f293afb4 req-dd11cc92-8e8d-4ecf-92ae-2c295ed83a69 tempest-ServerBootFromVolumeStableRescueTest-1611270976 None] Lock "cinder-df977523-99c5-46bd-aa5e-5d210e071a87-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:12 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524" returned: 0 in 0.624s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc9984-33cf-4adc-aa73-22f40b11e626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c64c910-6046-4590-9fbf-93b1bf40e524', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c2493a-0d4a-461a-b347-8a4f649af69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Volume volume-9c64c910-6046-4590-9fbf-93b1bf40e524 (9c64c910-6046-4590-9fbf-93b1bf40e524): created successfully Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c2493a-0d4a-461a-b347-8a4f649af69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Flow 'volume_create_manager' (c66561c2-78f0-458b-b5b6-925a74ad356a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-35694fd2-fdc2-4dc7-abfb-21c6a96c925b tempest-GroupSnapshotsTest-1868945976 None] Created volume successfully. Apr 08 17:40:13 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 1.162s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_owfiu_dadevstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:40:13 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Converted 112.00 MB image at 96.33 MB/s Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:13 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1G Apr 08 17:40:13 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:13 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 1G" returned: 0 in 0.490s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7772be4-3fab-498e-8703-944745671d6d]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:13 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:13 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] GroupSnapshot ef001833-052b-4d5c-a795-503cece7836f: creating. Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Group snapshot ef001833-052b-4d5c-a795-503cece7836f: creating. {{(pid=82664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Creating offline snapshot 2314e567-149a-4b66-a59a-539cb6067303 of volume 9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6dbe8-318e-4686-8fb4-e1ef6e78edfb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:14 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 Apr 08 17:40:14 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:14 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:14 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:14 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Flow 'volume_create_manager' (2a2c675c-ca41-4bfc-8e38-24f7f7ca26b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd8202-0676-4a0b-8ab1-6e3d5d230746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524" returned: 0 in 0.552s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:14 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 1G Apr 08 17:40:14 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cd8202-0676-4a0b-8ab1-6e3d5d230746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-469797779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c90cf-f073-4c87-b8cc-5ada18760f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14aca5aa7db94833869d3f63e7f844f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:15Z,use_quota=True,user_id='0609194859f34909869ebbe9bd826fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b460d2-16d5-465a-b3cd-94a7e9572f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b460d2-16d5-465a-b3cd-94a7e9572f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8647d171-8864-4263-9927-73f87f6cab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8647d171-8864-4263-9927-73f87f6cab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738c90cf-f073-4c87-b8cc-5ada18760f21', 'volume_name': 'volume-738c90cf-f073-4c87-b8cc-5ada18760f21', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562a4bd2-dc20-4661-979f-18fba98760f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562a4bd2-dc20-4661-979f-18fba98760f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e8fa65-17fc-41fb-a1f2-3f2db75b254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Volume 738c90cf-f073-4c87-b8cc-5ada18760f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738c90cf-f073-4c87-b8cc-5ada18760f21', 'volume_size': 1} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:14 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 1 in 0.572s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Downloaded image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 27840abc-c507-4359-892b-aefa821dc0dd successfully. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 for user 3c1c58d5f9ba452c91ecf2a420659f2c is deleted. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Marking volume 27840abc-c507-4359-892b-aefa821dc0dd as bootable. {{(pid=82664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Copying metadata from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 to 27840abc-c507-4359-892b-aefa821dc0dd. {{(pid=82664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Creating volume glance metadata for volume 27840abc-c507-4359-892b-aefa821dc0dd backed by image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3019dedb-374a-4460-b655-94ad1dc0a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27840abc-c507-4359-892b-aefa821dc0dd', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b8754a-b9b0-4d33-a18c-69816252918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Volume volume-27840abc-c507-4359-892b-aefa821dc0dd (27840abc-c507-4359-892b-aefa821dc0dd): created successfully Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b8754a-b9b0-4d33-a18c-69816252918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Flow 'volume_create_manager' (3e5ea1da-82de-4bc4-b8bf-9c11ad569c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5f8acc17-758a-45b1-a052-b51baf487952 tempest-VolumesExtendTest-1578957342 None] Created volume successfully. Apr 08 17:40:15 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 1G" returned: 0 in 0.668s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c64c910-6046-4590-9fbf-93b1bf40e524 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:15 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c64c910-6046-4590-9fbf-93b1bf40e524 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 Apr 08 17:40:15 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:15 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c64c910-6046-4590-9fbf-93b1bf40e524 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303" returned: 0 in 0.519s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:15 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:40:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:15 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 Apr 08 17:40:15 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:16 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303" returned: 0 in 0.462s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:16 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info Apr 08 17:40:16 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:16 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info" returned: 0 in 0.463s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:16 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:40:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:16 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info Apr 08 17:40:16 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:17 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.info" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.150s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-469797779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c90cf-f073-4c87-b8cc-5ada18760f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14aca5aa7db94833869d3f63e7f844f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:15Z,use_quota=True,user_id='0609194859f34909869ebbe9bd826fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Creating volume 738c90cf-f073-4c87-b8cc-5ada18760f21 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:17 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:17 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 1073741824 Apr 08 17:40:17 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-54e2620d-d7b0-461d-93ff-8037750cb40e tempest-GroupSnapshotsTest-1868945976 None] group_snapshot ef001833-052b-4d5c-a795-503cece7836f: created successfully Apr 08 17:40:17 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 1073741824" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:17 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 Apr 08 17:40:17 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:18 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.363s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e8fa65-17fc-41fb-a1f2-3f2db75b254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738c90cf-f073-4c87-b8cc-5ada18760f21', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642d9880-54f1-41f7-8180-c8c45c761d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:18 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Volume volume-738c90cf-f073-4c87-b8cc-5ada18760f21 (738c90cf-f073-4c87-b8cc-5ada18760f21): created successfully Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642d9880-54f1-41f7-8180-c8c45c761d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Flow 'volume_create_manager' (2a2c675c-ca41-4bfc-8e38-24f7f7ca26b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a69289-74b2-418e-b743-2bcfe7dc7e39]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9c4c41ce-3608-434d-838b-dffd79d73213 tempest-VolumesNegativeTest-1638758708 None] Created volume successfully. Apr 08 17:40:18 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:18 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot ef001833-052b-4d5c-a795-503cece7836f: deleting Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot ef001833-052b-4d5c-a795-503cece7836f: deleting {{(pid=82664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-2314e567-149a-4b66-a59a-539cb6067303" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-2314e567-149a-4b66-a59a-539cb6067303" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Deleting offline snapshot 2314e567-149a-4b66-a59a-539cb6067303 of volume 9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] snapshot_file for this snap is: volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde4a6b-7eb8-4d95-859f-1aebf743775f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:18 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 Apr 08 17:40:18 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:18 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 0.535s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:18 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:18 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:18 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303" returned: 0 in 0.545s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c64c910-6046-4590-9fbf-93b1bf40e524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c697c2-3e7d-4ccf-a592-4e3543e67872]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:19 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 Apr 08 17:40:19 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:19 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 1 in 0.590s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 2G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd 2G" returned: 0 in 0.034s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.199s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7e7db989-926f-4256-b4c0-f22af1a0b39d tempest-VolumesExtendTest-1578957342 None] Extend volume completed successfully. Apr 08 17:40:19 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524" returned: 0 in 0.540s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:19 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 Apr 08 17:40:19 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:19 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:20 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303 Apr 08 17:40:20 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-27840abc-c507-4359-892b-aefa821dc0dd-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "cinder-27840abc-c507-4359-892b-aefa821dc0dd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-quobyte-27840abc-c507-4359-892b-aefa821dc0dd" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-27840abc-c507-4359-892b-aefa821dc0dd" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[18034276-db6d-4e0b-80c9-647cc77e08ec]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:20 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:20 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:20 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524.2314e567-149a-4b66-a59a-539cb6067303" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-2314e567-149a-4b66-a59a-539cb6067303" released by "_delete_snapshot" :: held 2.226s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" released by "delete_snapshot" :: held 2.237s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:20 devstack cinder-volume[82664]: WARNING cinder.quota [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1143070860 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1143070860, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:20 devstack cinder-volume[82664]: WARNING cinder.quota [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1143070860 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1143070860, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['3be42cad-1adc-41e9-9227-b80020e4c10e', '77a1f382-38f8-4204-9a21-b4d3fb48b9c1', 'd90c7b41-67d0-4757-a7c8-c9ba173aa986', 'cad06bab-b0a4-474c-877a-c1b7b63e641d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-98a96601-d63e-4be6-86bc-a9c3ce8a23b5 tempest-GroupSnapshotsTest-1868945976 None] group_snapshot ef001833-052b-4d5c-a795-503cece7836f: deleted successfully Apr 08 17:40:20 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 0.552s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:20 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:20 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:21 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 1 in 0.558s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:21 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd Apr 08 17:40:21 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e535dc9-f4a3-4666-94fa-1ad5cafa599f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:21 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 Apr 08 17:40:21 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:21 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-27840abc-c507-4359-892b-aefa821dc0dd" returned: 0 in 0.561s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-27840abc-c507-4359-892b-aefa821dc0dd" released by "delete_volume" :: held 1.719s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:21 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Created reservations ['fcb3773d-e919-4adc-a2b9-9eeef6112f97', 'eb7420d4-61ed-4aa3-bb8e-5bc380249376', '2b533dd4-5131-4e3f-a54d-c3ab1da9b07b', 'fa366df3-bef8-41ce-9d89-92eca965df56'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:22 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:22 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:22 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524" returned: 0 in 0.594s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:22 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524 Apr 08 17:40:22 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Flow 'volume_create_manager' (0af74ac5-8f5e-4591-b0bc-937272d8cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:22 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8056d3b2-8937-4407-94f1-1808c7a081fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8056d3b2-8937-4407-94f1-1808c7a081fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-940731792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e6517f9264e429bd60ad94a7bf1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:23Z,use_quota=True,user_id='3c1c58d5f9ba452c91ecf2a420659f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f9e59-bb84-480f-b8b7-339d97151fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f9e59-bb84-480f-b8b7-339d97151fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5813bb93-438c-40a0-91f3-cbf26839c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5813bb93-438c-40a0-91f3-cbf26839c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc', 'volume_name': 'volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7183c657-3e88-4738-aa94-f67f24e93dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7183c657-3e88-4738-aa94-f67f24e93dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2390c977-8156-42e2-aa13-719b48bdfe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:22 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Volume 24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc', 'volume_size': 1} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-940731792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8e6517f9264e429bd60ad94a7bf1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:23Z,use_quota=True,user_id='3c1c58d5f9ba452c91ecf2a420659f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Creating volume 24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:22 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.702s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Deleted volume successfully. Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01564181-86ee-4ed4-9701-154524e3bb0f tempest-VolumesExtendTest-1578957342 None] Lock "cinder-27840abc-c507-4359-892b-aefa821dc0dd-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:22 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc 1073741824 Apr 08 17:40:22 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:22 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9c64c910-6046-4590-9fbf-93b1bf40e524" returned: 0 in 0.604s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Lock "cinder-quobyte-9c64c910-6046-4590-9fbf-93b1bf40e524" released by "delete_volume" :: held 1.232s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['57bbd225-1f4b-4263-b242-bed581dd2157'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:23 devstack cinder-volume[82664]: WARNING cinder.quota [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1143070860 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1143070860, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Created reservations ['62e7e538-26a6-4d31-bfbb-e1200e4e7ca4', 'bee8741b-4c92-4c31-9af1-f9223d76e4d2', 'e7bf00de-0118-4969-af3a-dad0efa07dde', '8aeedf47-c20b-4d1e-88d0-e1447d9cd2ce'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:23 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:23 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:23 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc 1073741824" returned: 0 in 0.611s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:23 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:23 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:23 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-697dcc40-f747-414b-9198-a019f240de21 tempest-GroupSnapshotsTest-1868945976 None] Delete group completed successfully. Apr 08 17:40:23 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2390c977-8156-42e2-aa13-719b48bdfe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd8c8d9-5556-474e-bc9b-2217ddfe099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:23 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Volume volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc (24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc): created successfully Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd8c8d9-5556-474e-bc9b-2217ddfe099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Flow 'volume_create_manager' (0af74ac5-8f5e-4591-b0bc-937272d8cfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5ade2e16-5f5c-49a7-aaa6-80f64ae95505 tempest-VolumesExtendTest-1578957342 None] Created volume successfully. Apr 08 17:40:24 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=257,cinder:SELECT=199,cinder:INSERT=67,cinder:DELETE=15 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:40:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Creating offline snapshot 03ea65e5-92ab-462f-95b7-a2a7f010d590 of volume 24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:40:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c01c37-0b27-4126-90dd-6812148fac49]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:25 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:25 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:25 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.594s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:25 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 1G Apr 08 17:40:25 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:26 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 1G" returned: 0 in 0.659s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:26 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 Apr 08 17:40:26 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:26 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590" returned: 0 in 0.560s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:26 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 is being set with open permissions: ugo+rw Apr 08 17:40:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:26 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 Apr 08 17:40:26 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:27 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590" returned: 0 in 0.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:27 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=221,cinder:INSERT=59,cinder:UPDATE=232,cinder:DELETE=13 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:40:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:27 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info Apr 08 17:40:27 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:27 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info" returned: 0 in 0.591s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:27 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info is being set with open permissions: ugo+rw Apr 08 17:40:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:28 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info Apr 08 17:40:28 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4bb5fb99-7df1-41ae-9a11-868a51bff0e0 tempest-GroupSnapshotsV319Test-257015192 None] Group tempest-GroupSnapshotsV319Test-Group-539858091: creating Apr 08 17:40:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4bb5fb99-7df1-41ae-9a11-868a51bff0e0 tempest-GroupSnapshotsV319Test-257015192 None] Group tempest-GroupSnapshotsV319Test-Group-539858091: created successfully Apr 08 17:40:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4bb5fb99-7df1-41ae-9a11-868a51bff0e0 tempest-GroupSnapshotsV319Test-257015192 None] Create group completed successfully. Apr 08 17:40:28 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.info" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4ec5d779-f958-4469-95fe-4b4190ed56dd tempest-VolumesExtendTest-1578957342 None] Create snapshot completed successfully Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade0ccf-e5b3-4662-9153-d8855df64eac]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:29 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:29 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Flow 'volume_create_manager' (3f2ed10d-2c67-45f8-b0df-73003e190ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e82b66c-67b2-4e38-93eb-e2c10675c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e82b66c-67b2-4e38-93eb-e2c10675c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509147763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0a8d7f3-a0a2-4189-87c2-7a69f23c7fae,host='devstack@QuobyteHD#QuobyteHD',id=faa49130-95cb-4e2f-b510-ba3f223a57d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245f649d2ce6487096382a1da00b8426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:30Z,use_quota=True,user_id='a5b48c8c30a34a418e2e3dd75ff28689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7122a54f-f2b9-42db-85ba-2f2a64f22ba1),volume_type_id=7122a54f-f2b9-42db-85ba-2f2a64f22ba1)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac927c-c0c5-458d-b240-e277d4082412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac927c-c0c5-458d-b240-e277d4082412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e04fe0-5333-423b-8522-28e3b8701224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e04fe0-5333-423b-8522-28e3b8701224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa49130-95cb-4e2f-b510-ba3f223a57d4', 'volume_name': 'volume-faa49130-95cb-4e2f-b510-ba3f223a57d4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea22a99-e99a-46fb-93b7-9d1224a65e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea22a99-e99a-46fb-93b7-9d1224a65e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57eb1ca-902e-4d56-9aef-cbf73ec752f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:29 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Volume faa49130-95cb-4e2f-b510-ba3f223a57d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa49130-95cb-4e2f-b510-ba3f223a57d4', 'volume_size': 1} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:29 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.619s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 2G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 2G" returned: 0 in 0.091s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.726s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0a8d7f3-a0a2-4189-87c2-7a69f23c7fae,created_at=2026-04-08T15:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509147763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0a8d7f3-a0a2-4189-87c2-7a69f23c7fae,host='devstack@QuobyteHD#QuobyteHD',id=faa49130-95cb-4e2f-b510-ba3f223a57d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245f649d2ce6487096382a1da00b8426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:30Z,use_quota=True,user_id='a5b48c8c30a34a418e2e3dd75ff28689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7122a54f-f2b9-42db-85ba-2f2a64f22ba1),volume_type_id=7122a54f-f2b9-42db-85ba-2f2a64f22ba1)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Creating volume faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:29 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:29 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 1073741824 Apr 08 17:40:29 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3ce36a77-0d15-40a5-aeed-07f25f12a536 tempest-VolumesExtendTest-1578957342 None] Extend volume completed successfully. Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-03ea65e5-92ab-462f-95b7-a2a7f010d590-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-03ea65e5-92ab-462f-95b7-a2a7f010d590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-quobyte-03ea65e5-92ab-462f-95b7-a2a7f010d590" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-03ea65e5-92ab-462f-95b7-a2a7f010d590" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Deleting offline snapshot 03ea65e5-92ab-462f-95b7-a2a7f010d590 of volume 24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] snapshot_file for this snap is: volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ced832-31d8-4c44-b51d-aeb66002cf27]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:30 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 1073741824" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:30 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 Apr 08 17:40:30 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:30 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 Apr 08 17:40:30 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:31 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590" returned: 0 in 0.762s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d6e91-2f3d-42cf-8dd1-037ea23fb95f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:31 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4" returned: 0 in 0.864s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57eb1ca-902e-4d56-9aef-cbf73ec752f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa49130-95cb-4e2f-b510-ba3f223a57d4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4fc69-28d5-4978-88a1-16d6baa084aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:31 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Volume volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 (faa49130-95cb-4e2f-b510-ba3f223a57d4): created successfully Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4fc69-28d5-4978-88a1-16d6baa084aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Flow 'volume_create_manager' (3f2ed10d-2c67-45f8-b0df-73003e190ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:31 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:31 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-108cef80-c42d-4e18-9fad-c2f11e7defb8 tempest-GroupSnapshotsV319Test-257015192 None] Created volume successfully. Apr 08 17:40:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] GroupSnapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: creating. Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Group snapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: creating. {{(pid=82664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Creating offline snapshot 892e53c3-52eb-4d77-a2a0-b41ac00317e1 of volume faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def000d-2dd6-43e6-9d9c-ca8bef5f84fa]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:32 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 Apr 08 17:40:32 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:32 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.976s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:32 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 Apr 08 17:40:32 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:32 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590" returned: 0 in 0.628s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:32 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590 Apr 08 17:40:32 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:32 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4" returned: 0 in 0.829s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:32 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 1G Apr 08 17:40:32 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:33 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc.03ea65e5-92ab-462f-95b7-a2a7f010d590" returned: 0 in 0.497s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-03ea65e5-92ab-462f-95b7-a2a7f010d590" released by "_delete_snapshot" :: held 2.972s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" released by "delete_snapshot" :: held 2.994s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Created reservations ['338b5a26-f93d-4e6a-9c40-24772aa3094b', 'aa3f48d4-cff5-4e8d-b0a5-c254ec5ede1e', '108176bf-d9d6-4b01-af59-22a522971af8', '6ca5a3cc-cb79-4001-ae50-2f1483fa68e5'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:33 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 1G" returned: 0 in 0.562s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:33 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 Apr 08 17:40:33 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Delete snapshot completed successfully. Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8e6690a0-a057-4eb3-bf92-4e8c9fd47dbf tempest-VolumesExtendTest-1578957342 None] Lock "cinder-03ea65e5-92ab-462f-95b7-a2a7f010d590-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "cinder-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c4ca5-f031-4923-8198-6b41000e9dfa]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:34 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:34 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:34 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1" returned: 0 in 0.696s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:34 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:34 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 Apr 08 17:40:34 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:34 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.632s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:34 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc Apr 08 17:40:34 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:34 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1" returned: 0 in 0.479s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:34 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info Apr 08 17:40:34 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:35 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" returned: 0 in 0.538s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "cinder-quobyte-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc" released by "delete_volume" :: held 1.217s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Created reservations ['5c5f9ca3-99b4-4776-9db4-1757645bf3ef', '52bf1db0-8ffd-4286-a4e3-9ee2650c9994', '04926d9b-7c38-4904-bd06-eb76e5582bf0', '2ff167bf-b77a-4d08-802c-f82c2e3ae166'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:35 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:35 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:35 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info" returned: 0 in 0.656s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:35 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:35 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info Apr 08 17:40:35 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:35 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.583s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Deleted volume successfully. Apr 08 17:40:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f276cbe-2bd8-4a47-97d6-f892f8415347 tempest-VolumesExtendTest-1578957342 None] Lock "cinder-24cf914c-ea60-4eaf-9a8a-0c98f6ce99cc-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:36 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.info" returned: 0 in 0.678s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-29b0faea-c2c9-46f7-a145-ddeebe34a57c tempest-GroupSnapshotsV319Test-257015192 None] group_snapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: created successfully Apr 08 17:40:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] group_snapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: deleting Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] group_snapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: deleting {{(pid=82664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "cinder-quobyte-892e53c3-52eb-4d77-a2a0-b41ac00317e1" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-892e53c3-52eb-4d77-a2a0-b41ac00317e1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Deleting offline snapshot 892e53c3-52eb-4d77-a2a0-b41ac00317e1 of volume faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] snapshot_file for this snap is: volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c96e73-67ad-40d7-bed1-a9e73995daa5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:36 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 Apr 08 17:40:36 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:37 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1" returned: 0 in 0.663s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faa49130-95cb-4e2f-b510-ba3f223a57d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4b7ce3-9b83-4bea-a143-5304e4e94edb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:37 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 Apr 08 17:40:37 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:37 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4" returned: 0 in 0.592s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:37 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 Apr 08 17:40:37 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:37 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (cad22c74-362a-47ee-8970-b2e81da60c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42babb0b-9a1e-451c-819b-5c262db172d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42babb0b-9a1e-451c-819b-5c262db172d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1272606930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29627f4-02bc-49fc-9a03-cfc961b0b093,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:38Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92033e9-42b4-4557-8e16-4a15d62c4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92033e9-42b4-4557-8e16-4a15d62c4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e3d78d-f401-49ed-af30-ce8b06730459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e3d78d-f401-49ed-af30-ce8b06730459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29627f4-02bc-49fc-9a03-cfc961b0b093', 'volume_name': 'volume-c29627f4-02bc-49fc-9a03-cfc961b0b093', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e65b71-4e87-4115-82b6-2b958b32937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e65b71-4e87-4115-82b6-2b958b32937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ca2d0-dccc-4841-9534-ac4b293d1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:38 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Volume c29627f4-02bc-49fc-9a03-cfc961b0b093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29627f4-02bc-49fc-9a03-cfc961b0b093', 'volume_size': 1} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1272606930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29627f4-02bc-49fc-9a03-cfc961b0b093,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:38Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Creating volume c29627f4-02bc-49fc-9a03-cfc961b0b093 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:38 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:38 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 1073741824 Apr 08 17:40:38 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:38 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1" returned: 0 in 0.505s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:38 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1 Apr 08 17:40:38 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:38 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 1073741824" returned: 0 in 0.533s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:38 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 Apr 08 17:40:38 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:38 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4.892e53c3-52eb-4d77-a2a0-b41ac00317e1" returned: 0 in 0.444s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-892e53c3-52eb-4d77-a2a0-b41ac00317e1" released by "_delete_snapshot" :: held 2.262s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" released by "delete_snapshot" :: held 2.283s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:38 devstack cinder-volume[82664]: WARNING cinder.quota [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1338398583 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1338398583, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:38 devstack cinder-volume[82664]: WARNING cinder.quota [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1338398583 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1338398583, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:38 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] Created reservations ['471dd428-8395-440a-8898-207644451ee3', 'f6c5e25f-03cf-495c-af91-d5e108ad9fa2', '681877db-7692-4337-a915-66149d35dbf7', 'c9dfd136-22c4-4b11-9239-0844bf497a8d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1274154f-eb17-4fc0-835c-c14066caa183 tempest-GroupSnapshotsV319Test-257015192 None] group_snapshot b9661e2d-5e6a-4540-b5de-0bdd47710595: deleted successfully Apr 08 17:40:39 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ca2d0-dccc-4841-9534-ac4b293d1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29627f4-02bc-49fc-9a03-cfc961b0b093', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca3abb6-08ba-4cc1-bcee-434ce1cbcd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:39 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Volume volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 (c29627f4-02bc-49fc-9a03-cfc961b0b093): created successfully Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca3abb6-08ba-4cc1-bcee-434ce1cbcd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (cad22c74-362a-47ee-8970-b2e81da60c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-99b9c050-d82a-4e40-8037-a131ac14dbc5 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee738df-f793-4e68-bb96-2dbfddb2ce7f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:40 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 Apr 08 17:40:40 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (3201ddba-7a87-4ed8-a5fc-38287c8a4db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:40 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356312ca-0188-4de2-994d-15875505ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356312ca-0188-4de2-994d-15875505ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197184414',display_name='tempest-VolumesGetTest-Volume-578023310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6b32b7-940b-486f-bb99-c754141f69a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:41Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d6177f-31df-4954-8d87-9f69f881f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d6177f-31df-4954-8d87-9f69f881f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafa1a3a-9788-4961-a748-a3ea89c224d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafa1a3a-9788-4961-a748-a3ea89c224d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6b32b7-940b-486f-bb99-c754141f69a0', 'volume_name': 'volume-5e6b32b7-940b-486f-bb99-c754141f69a0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91eaeddc-2906-476b-a61c-db267bf19aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91eaeddc-2906-476b-a61c-db267bf19aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081e52e2-67f4-487d-9662-82a700d1c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:40 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Volume 5e6b32b7-940b-486f-bb99-c754141f69a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6b32b7-940b-486f-bb99-c754141f69a0', 'volume_size': 1} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-197184414',display_name='tempest-VolumesGetTest-Volume-578023310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6b32b7-940b-486f-bb99-c754141f69a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:41Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Creating volume 5e6b32b7-940b-486f-bb99-c754141f69a0 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:40 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4" returned: 0 in 0.718s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:40 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 1073741824 Apr 08 17:40:40 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:40 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4 Apr 08 17:40:40 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:41 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-faa49130-95cb-4e2f-b510-ba3f223a57d4" returned: 0 in 0.530s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Lock "cinder-quobyte-faa49130-95cb-4e2f-b510-ba3f223a57d4" released by "delete_volume" :: held 1.292s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:41 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 1073741824" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Created reservations ['cd4eb71b-e43e-462e-9a4b-53cced4969ef'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:41 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 Apr 08 17:40:41 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:41 devstack cinder-volume[82664]: WARNING cinder.quota [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1338398583 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1338398583, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Created reservations ['6351541f-48ba-470e-8b8d-90979f04b95e', '5bb69b5c-f424-4f4c-8120-c79ae79d5f25', '706d2e83-9c6c-4b24-9a62-95d31aabf1a6', '9859c564-fb65-4b7b-98fc-113e1232d44b'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:41 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:41 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:41 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0" returned: 0 in 0.506s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081e52e2-67f4-487d-9662-82a700d1c021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6b32b7-940b-486f-bb99-c754141f69a0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65b072f-0e70-43ef-b26e-258868cfd2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:41 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Volume volume-5e6b32b7-940b-486f-bb99-c754141f69a0 (5e6b32b7-940b-486f-bb99-c754141f69a0): created successfully Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65b072f-0e70-43ef-b26e-258868cfd2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (3201ddba-7a87-4ed8-a5fc-38287c8a4db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:41 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-abba80d7-b1ef-4aa9-9596-b9fa7aac1125 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:40:41 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:41 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:41 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6828b837-92f4-44c6-b964-4f6497972194 tempest-GroupSnapshotsV319Test-257015192 None] Delete group completed successfully. Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-5e6b32b7-940b-486f-bb99-c754141f69a0-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "cinder-5e6b32b7-940b-486f-bb99-c754141f69a0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-5e6b32b7-940b-486f-bb99-c754141f69a0" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-5e6b32b7-940b-486f-bb99-c754141f69a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f070807b-5c78-4edb-9fbb-b4196752d7a8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:43 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 Apr 08 17:40:43 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:43 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0" returned: 0 in 0.613s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:43 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0 Apr 08 17:40:43 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:44 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5e6b32b7-940b-486f-bb99-c754141f69a0" returned: 0 in 0.561s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-5e6b32b7-940b-486f-bb99-c754141f69a0" released by "delete_volume" :: held 1.201s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Created reservations ['76a9b8ce-6ddb-47bf-b110-0ffa80b079b2', '4f82708e-0401-48e2-9bd0-50ad1943858b', '870a1003-f141-497a-ac73-9732fc167261', '631c188f-9b6d-4460-93ef-9d7be6665b06'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:44 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:44 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:44 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:44 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:40:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74f9c81c-610e-48a1-9d70-d9fffa3cf239 tempest-VolumesGetTest-117147952 None] Lock "cinder-5e6b32b7-940b-486f-bb99-c754141f69a0-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-c29627f4-02bc-49fc-9a03-cfc961b0b093-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "cinder-c29627f4-02bc-49fc-9a03-cfc961b0b093-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-c29627f4-02bc-49fc-9a03-cfc961b0b093" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-c29627f4-02bc-49fc-9a03-cfc961b0b093" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[10566e04-bc9c-4ff4-8223-691f8b133c0a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:45 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 Apr 08 17:40:45 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:45 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:45 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093 Apr 08 17:40:45 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44b2a6e1-c18f-441b-b7ec-ccd0d6ef4489 tempest-GroupsV320Test-1649936551 None] Group tempest-GroupsV320Test-Group-288732164: creating Apr 08 17:40:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44b2a6e1-c18f-441b-b7ec-ccd0d6ef4489 tempest-GroupsV320Test-1649936551 None] Group tempest-GroupsV320Test-Group-288732164: created successfully Apr 08 17:40:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44b2a6e1-c18f-441b-b7ec-ccd0d6ef4489 tempest-GroupsV320Test-1649936551 None] Create group completed successfully. Apr 08 17:40:46 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c29627f4-02bc-49fc-9a03-cfc961b0b093" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-c29627f4-02bc-49fc-9a03-cfc961b0b093" released by "delete_volume" :: held 1.095s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Created reservations ['55cf572b-342d-4ca9-8bd3-f98c70ba6d95', '49d09d1e-26ae-44e5-af82-649498be42c3', '7846f0c6-5651-47f1-86cd-2543138aea15', '4481e80e-2f61-4783-80a6-c6cdc3208bf3'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:46 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:46 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:46 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:40:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6112a625-3945-4577-bfd0-fb9926bcb732 tempest-VolumesGetTest-117147952 None] Lock "cinder-c29627f4-02bc-49fc-9a03-cfc961b0b093-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Created reservations ['32efe2fc-03f5-4895-b83d-b4428eca1900'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:47 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:47 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (9804445a-16e3-4580-ad87-6d3abc6a831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf1f9c0-aaee-4a52-ae49-acee2c1611df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf1f9c0-aaee-4a52-ae49-acee2c1611df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853424049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:48Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93cdf67-1d19-4da4-8f2a-47486a313e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93cdf67-1d19-4da4-8f2a-47486a313e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f896b-0076-4128-b361-d9359e47d8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f896b-0076-4128-b361-d9359e47d8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'volume_name': 'volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e9bfd3-4dd9-4690-b317-f37247b6d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e9bfd3-4dd9-4690-b317-f37247b6d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee59617-b474-4ff6-b64e-2e21c25f7345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:47 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Volume 5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'volume_size': 1} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853424049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:48Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Creating volume 5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:40:47 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:40:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:48 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc 1073741824 Apr 08 17:40:48 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:48 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:48 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e09b9b01-c407-4870-8559-d90346d2e1f7 tempest-GroupsV320Test-1649936551 None] Delete group completed successfully. Apr 08 17:40:48 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc 1073741824" returned: 0 in 0.861s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:49 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:40:49 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:49 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 0.939s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee59617-b474-4ff6-b64e-2e21c25f7345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb295b-2e7c-4374-bfec-d9bd0701dc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:49 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Volume volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc (5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc): created successfully Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb295b-2e7c-4374-bfec-d9bd0701dc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (9804445a-16e3-4580-ad87-6d3abc6a831e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-16d33d7c-814f-4e0a-89b5-682b987e6971 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Acquiring lock "cinder-738c90cf-f073-4c87-b8cc-5ada18760f21-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "cinder-738c90cf-f073-4c87-b8cc-5ada18760f21-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Acquiring lock "cinder-quobyte-738c90cf-f073-4c87-b8cc-5ada18760f21" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "cinder-quobyte-738c90cf-f073-4c87-b8cc-5ada18760f21" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd8fab2-91bc-4bb7-a5d3-97bd0410187c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (7e73c5e8-b2ce-463e-9b3a-a6e2d9a33716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ad37c1-f351-424a-8df5-1fc33b21fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ad37c1-f351-424a-8df5-1fc33b21fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1401082457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3386bfc0-de48-4d2a-8bb4-e79e9afb02b4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:51Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47759442-ea9d-4a0c-8401-570c4b07ca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47759442-ea9d-4a0c-8401-570c4b07ca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb34d7d2-d1c0-4f62-b65d-4fbf538ca2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb34d7d2-d1c0-4f62-b65d-4fbf538ca2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3386bfc0-de48-4d2a-8bb4-e79e9afb02b4', 'volume_name': 'volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4', 'volume_size': 1, 'source_volid': '5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a9448c-9846-446d-a0c8-19c354186206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a9448c-9846-446d-a0c8-19c354186206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93000c0c-fffd-45b3-a7e4-fc1e5b61889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:50 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Volume 3386bfc0-de48-4d2a-8bb4-e79e9afb02b4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4', 'volume_size': 1, 'source_volid': '5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'source_volstatus': 'available'} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:50 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Cloning volume 5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc to volume 3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 Apr 08 17:40:50 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 Apr 08 17:40:50 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Creating offline snapshot cb1758e7-ec6c-4078-9568-20d3829f58f5 of volume 5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b726af-b8b5-4528-b7d4-4d70516d7a0d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:51 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:40:51 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:51 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21" returned: 0 in 1.133s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:51 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21 Apr 08 17:40:51 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:52 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 1.278s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:52 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 1G Apr 08 17:40:52 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:52 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-738c90cf-f073-4c87-b8cc-5ada18760f21" returned: 0 in 0.766s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "cinder-quobyte-738c90cf-f073-4c87-b8cc-5ada18760f21" released by "delete_volume" :: held 1.967s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Created reservations ['0316c978-22a5-4b83-b13f-7b5e8625c161', '24372b30-dcf9-4b60-867b-4a148acbfe77', '29b125fe-fb32-4a9e-8d26-3a34889ec3b8', '0e9f986a-9769-4247-8aeb-17fcb4aa6005'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:52 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:40:52 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:53 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 1G" returned: 0 in 1.094s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:53 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:40:53 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:53 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.885s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:53 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:40:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Deleted volume successfully. Apr 08 17:40:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-66133292-1963-4f71-8933-bd3e696e17fb tempest-VolumesNegativeTest-1638758708 None] Lock "cinder-738c90cf-f073-4c87-b8cc-5ada18760f21-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:40:54 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 0.843s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:54 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 is being set with open permissions: ugo+rw Apr 08 17:40:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:54 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:40:54 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:54 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 0.597s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:54 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info Apr 08 17:40:54 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:55 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info" returned: 0 in 0.835s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:55 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info is being set with open permissions: ugo+rw Apr 08 17:40:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:55 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info Apr 08 17:40:55 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (1f97639e-33aa-401f-b522-736fecc9fe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f99dbf0-0120-4846-9537-7f8601c7fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f99dbf0-0120-4846-9537-7f8601c7fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121984721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c5c731-7fa9-4830-b383-5bed7d457562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:56Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586d1a3f-8c11-4efd-bf87-b6acbc50fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586d1a3f-8c11-4efd-bf87-b6acbc50fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45df554-3dde-4a01-b40f-ab5d69cd20ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45df554-3dde-4a01-b40f-ab5d69cd20ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c5c731-7fa9-4830-b383-5bed7d457562', 'volume_name': 'volume-f1c5c731-7fa9-4830-b383-5bed7d457562', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465514bf-27ec-478c-895b-1ed0a2b1823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465514bf-27ec-478c-895b-1ed0a2b1823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1059746-a392-460d-a6d9-0d0b0254aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:40:56 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume f1c5c731-7fa9-4830-b383-5bed7d457562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c5c731-7fa9-4830-b383-5bed7d457562', 'volume_size': 1} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:56 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.info" returned: 0 in 0.684s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] snapshot: cb1758e7-ec6c-4078-9568-20d3829f58f5, volume: 3386bfc0-de48-4d2a-8bb4-e79e9afb02b4, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e316019-e463-4b1c-b435-a4e5a7c607f7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:56 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:40:56 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:56 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 0.468s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b09227-c8f7-477c-8c30-84766573bad8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:40:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:56 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:40:56 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:40:57 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 08 17:40:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:40:57 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:40:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:40:57 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 Apr 08 17:40:57 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:00 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" returned: 0 in 2.770s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55b34a0-42f4-48bf-a5e6-b014317de44e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:00 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:41:00 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:00 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 0.853s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:41:00 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Converted 1024.00 MB image at 369.58 MB/s Apr 08 17:41:00 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 is being set with open permissions: ugo+rw Apr 08 17:41:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:00 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 Apr 08 17:41:00 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:01 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" returned: 0 in 0.853s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" released by "_copy_volume_from_snapshot" :: held 5.531s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-cb1758e7-ec6c-4078-9568-20d3829f58f5" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-cb1758e7-ec6c-4078-9568-20d3829f58f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Deleting offline snapshot cb1758e7-ec6c-4078-9568-20d3829f58f5 of volume 5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] snapshot_file for this snap is: volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[657343fe-2df9-40c6-b0be-5632eda57f61]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:01 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:41:01 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:02 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 0.628s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[58901027-ce16-4c6b-a2c0-be1b15518282]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:02 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:41:02 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:02 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:02 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:03 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 0.592s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:03 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:41:03 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:03 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.858s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Flow 'volume_create_manager' (9fab842d-f8b1-4ec6-ac77-3c9ad9592b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57010f7-fe1e-4c03-a505-21ff2ac4df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57010f7-fe1e-4c03-a505-21ff2ac4df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-969699097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3857767a-9bdb-4fcc-bdfc-51f83b2a466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00492eb293ca4f4dabbddb0ebd950569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:04Z,use_quota=True,user_id='558795c31ff34822b5fd047fefaf7a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4c57fb-eac7-4be2-863d-06247d69e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4c57fb-eac7-4be2-863d-06247d69e660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfa6990-0505-4475-ac94-7bde58cf6aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfa6990-0505-4475-ac94-7bde58cf6aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3857767a-9bdb-4fcc-bdfc-51f83b2a466b', 'volume_name': 'volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5663201-be8f-457d-a139-5c8b726a082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5663201-be8f-457d-a139-5c8b726a082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e80108-8c36-4063-9899-da090e733071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Volume 3857767a-9bdb-4fcc-bdfc-51f83b2a466b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b', 'volume_size': 1} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:04 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 1.313s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:04 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5 Apr 08 17:41:04 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:04 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc.cb1758e7-ec6c-4078-9568-20d3829f58f5" returned: 0 in 0.476s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-cb1758e7-ec6c-4078-9568-20d3829f58f5" released by "_delete_snapshot" :: held 3.077s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.115s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.738s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121984721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c5c731-7fa9-4830-b383-5bed7d457562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:40:56Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:04 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:04 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 1073741824 Apr 08 17:41:04 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93000c0c-fffd-45b3-a7e4-fc1e5b61889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4', 'volume_size': 1, 'source_volid': '5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1030aca-86df-4efc-b124-71b2ad27aca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Volume volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 (3386bfc0-de48-4d2a-8bb4-e79e9afb02b4): created successfully Apr 08 17:41:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1030aca-86df-4efc-b124-71b2ad27aca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (7e73c5e8-b2ce-463e-9b3a-a6e2d9a33716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cea7146f-4499-454a-b403-39dfd1b68b68 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:41:05 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 1073741824" returned: 0 in 0.807s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:05 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 Apr 08 17:41:05 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:06 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562" returned: 0 in 0.848s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-969699097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3857767a-9bdb-4fcc-bdfc-51f83b2a466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00492eb293ca4f4dabbddb0ebd950569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:04Z,use_quota=True,user_id='558795c31ff34822b5fd047fefaf7a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Creating volume 3857767a-9bdb-4fcc-bdfc-51f83b2a466b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:06 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1059746-a392-460d-a6d9-0d0b0254aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c5c731-7fa9-4830-b383-5bed7d457562', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad023ce-d668-4868-acac-e2fb0c672cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-f1c5c731-7fa9-4830-b383-5bed7d457562 (f1c5c731-7fa9-4830-b383-5bed7d457562): created successfully Apr 08 17:41:06 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b 1073741824 Apr 08 17:41:06 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad023ce-d668-4868-acac-e2fb0c672cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (1f97639e-33aa-401f-b522-736fecc9fe37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bcd00f0a-ab63-4080-8ba4-cd26b1d52da0 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:06 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (f47a013a-5497-49e7-915f-d8f8df5c1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387e4208-14b6-4c04-8c00-de78bf258c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387e4208-14b6-4c04-8c00-de78bf258c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1145624663',display_name='tempest-VolumesGetTest-Volume-562672242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a42c1e2-cdf7-48e2-bd97-e86e77a93257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:07Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e3dee6-59f0-48e0-ad94-2e549877c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e3dee6-59f0-48e0-ad94-2e549877c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5275c073-7fe1-42ef-a3cf-dca105781d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5275c073-7fe1-42ef-a3cf-dca105781d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a42c1e2-cdf7-48e2-bd97-e86e77a93257', 'volume_name': 'volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89af5fa5-498b-4314-87a7-abe36b2c5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89af5fa5-498b-4314-87a7-abe36b2c5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39427303-decd-419e-bf68-dc83032cb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Volume 3a42c1e2-cdf7-48e2-bd97-e86e77a93257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257', 'volume_size': 1} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:07 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b 1073741824" returned: 0 in 0.812s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:07 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b Apr 08 17:41:07 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:08 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" returned: 0 in 0.657s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1145624663',display_name='tempest-VolumesGetTest-Volume-562672242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a42c1e2-cdf7-48e2-bd97-e86e77a93257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:07Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Creating volume 3a42c1e2-cdf7-48e2-bd97-e86e77a93257 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:08 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e80108-8c36-4063-9899-da090e733071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da42feb1-765c-42e5-b40a-f6213e68f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:08 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 1073741824 Apr 08 17:41:08 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Volume volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b (3857767a-9bdb-4fcc-bdfc-51f83b2a466b): created successfully Apr 08 17:41:08 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da42feb1-765c-42e5-b40a-f6213e68f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Flow 'volume_create_manager' (9fab842d-f8b1-4ec6-ac77-3c9ad9592b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:08 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8f50ef51-4b80-42f0-9f29-1f578d0a0b5a tempest-ServerRescueNegativeTestJSON-1615747022 None] Created volume successfully. Apr 08 17:41:09 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 1073741824" returned: 0 in 0.998s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:09 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 Apr 08 17:41:09 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Flow 'volume_create_manager' (47eac610-68c7-4b75-97be-c7a433e83a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7d096-d3e1-4591-b0b8-bca22ca83bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7d096-d3e1-4591-b0b8-bca22ca83bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-358985503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312937a1-e359-4f39-a080-f5b3751b9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ae519a4b3a4588a8c6a403e286d411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:09Z,use_quota=True,user_id='b6f93d8767794013b7950538f18d0fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3927d7-8eee-43ff-9b33-eb31d21fbf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3927d7-8eee-43ff-9b33-eb31d21fbf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a784992-7830-4319-b5bc-564dc129f14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a784992-7830-4319-b5bc-564dc129f14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312937a1-e359-4f39-a080-f5b3751b9257', 'volume_name': 'volume-312937a1-e359-4f39-a080-f5b3751b9257', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf524c9-cdc9-49aa-8041-3f556909a5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf524c9-cdc9-49aa-8041-3f556909a5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4014d651-8323-46fd-aa9e-864dfe3ac385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume 312937a1-e359-4f39-a080-f5b3751b9257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312937a1-e359-4f39-a080-f5b3751b9257', 'volume_size': 1} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:09 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" returned: 0 in 0.546s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.795s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39427303-decd-419e-bf68-dc83032cb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa18311f-2a18-4ef5-8c85-ecd4c69b6167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating offline snapshot b881fe7a-c141-4474-be44-590f9fecde5c of volume f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:41:09 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Volume volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 (3a42c1e2-cdf7-48e2-bd97-e86e77a93257): created successfully Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa18311f-2a18-4ef5-8c85-ecd4c69b6167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (f47a013a-5497-49e7-915f-d8f8df5c1679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1671de27-13d5-47bb-971b-939c9138a9fe]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-49109b47-8cff-45ea-84f7-77ab886a5576 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:41:09 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 Apr 08 17:41:09 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-3a42c1e2-cdf7-48e2-bd97-e86e77a93257-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "cinder-3a42c1e2-cdf7-48e2-bd97-e86e77a93257-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:10 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562" returned: 0 in 0.635s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d15af-b173-47a2-b58d-1ee89c43cb6d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:10 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c 1G Apr 08 17:41:10 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:10 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 Apr 08 17:41:10 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:10 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" returned: 0 in 0.512s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:10 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257 Apr 08 17:41:10 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:10 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c 1G" returned: 0 in 0.577s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c5c731-7fa9-4830-b383-5bed7d457562 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:11 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c5c731-7fa9-4830-b383-5bed7d457562 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c Apr 08 17:41:11 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:11 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3a42c1e2-cdf7-48e2-bd97-e86e77a93257" released by "delete_volume" :: held 1.103s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Created reservations ['6c6f6068-8454-4038-8f42-af0a686bf858', 'f91d9ac4-61c7-4871-9eaa-2955851a0fe1', '0d51976b-37b2-45b3-8762-914cdfb26100', 'a6106e10-199f-4221-bed8-075333600c65'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:11 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1c5c731-7fa9-4830-b383-5bed7d457562 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:11 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c is being set with open permissions: ugo+rw Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:11 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:11 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:11 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c Apr 08 17:41:11 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:11 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.393s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:41:11 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-99ab041b-edf1-45aa-bfa7-ccc690072034 tempest-VolumesGetTest-117147952 None] Lock "cinder-3a42c1e2-cdf7-48e2-bd97-e86e77a93257-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c" returned: 0 in 0.414s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:12 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info Apr 08 17:41:12 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "cinder-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:12 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info" returned: 0 in 0.653s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:12 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info is being set with open permissions: ugo+rw Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7a8dda-fe9f-421d-9bff-200c55e904d3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:12 devstack sudo[87023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info Apr 08 17:41:12 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:12 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 Apr 08 17:41:12 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:13 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.info" returned: 0 in 0.421s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.611s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-358985503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312937a1-e359-4f39-a080-f5b3751b9257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ae519a4b3a4588a8c6a403e286d411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:09Z,use_quota=True,user_id='b6f93d8767794013b7950538f18d0fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Creating volume 312937a1-e359-4f39-a080-f5b3751b9257 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:13 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7998d829-2dd2-47b3-9c21-538a975cc4d9 tempest-CreateVolumesFromSnapshotTest-694161594 None] Create snapshot completed successfully Apr 08 17:41:13 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 1073741824 Apr 08 17:41:13 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:13 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:13 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4 Apr 08 17:41:13 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:13 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4" released by "delete_volume" :: held 0.955s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Created reservations ['a1d1634e-e488-4aea-ace4-a4b73301c293', '1214927c-846d-4a6f-b355-b366cdd8b2ad', '922967f0-37c1-428f-89e7-279c323fc842', 'a66d5d50-7f04-43fa-99a2-a167faf63349'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:13 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 1073741824" returned: 0 in 0.589s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:13 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:13 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:13 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:13 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "cinder-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" acquired by "delete_volume" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872d3df-87a5-49c1-ae33-45809ee44ecc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:13 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:41:13 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:14 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257" returned: 0 in 0.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4014d651-8323-46fd-aa9e-864dfe3ac385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312937a1-e359-4f39-a080-f5b3751b9257', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2214367a-3622-4b6f-a178-928c4335e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume volume-312937a1-e359-4f39-a080-f5b3751b9257 (312937a1-e359-4f39-a080-f5b3751b9257): created successfully Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2214367a-3622-4b6f-a178-928c4335e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Flow 'volume_create_manager' (47eac610-68c7-4b75-97be-c7a433e83a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9535ff16-b38c-44e4-8001-c649b1a20a79 tempest-VolumeQuotasAdminTestJSON-58712098 None] Created volume successfully. Apr 08 17:41:14 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.527s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d95ed6f6-a0e7-427b-b070-2af77cd0e0b8 tempest-VolumesGetTest-117147952 None] Lock "cinder-3386bfc0-de48-4d2a-8bb4-e79e9afb02b4-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (4d9026b2-ab3f-4878-bde7-4f647ce636a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02225a27-0567-49ef-9f15-ce721e2f13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02225a27-0567-49ef-9f15-ce721e2f13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016412283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ced2fcd-6e68-4373-9fdd-28cd729d0d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:14Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d4d319-61a5-4a76-a4af-88d6bae6ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d4d319-61a5-4a76-a4af-88d6bae6ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bd6596-d1ea-4d8d-805c-6ee3da0c810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bd6596-d1ea-4d8d-805c-6ee3da0c810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ced2fcd-6e68-4373-9fdd-28cd729d0d7c', 'volume_name': 'volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7907a50a-a6b3-46b4-98ad-5a6779f742c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7907a50a-a6b3-46b4-98ad-5a6779f742c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bca584d-d6b7-402e-b62f-96a0a754ec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume 5ced2fcd-6e68-4373-9fdd-28cd729d0d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c', 'volume_size': 1} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016412283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ced2fcd-6e68-4373-9fdd-28cd729d0d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:14Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume 5ced2fcd-6e68-4373-9fdd-28cd729d0d7c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:14 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 0.709s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:14 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc Apr 08 17:41:14 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:14 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c 1073741824 Apr 08 17:41:14 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (92202ed7-3453-40dc-a269-e520c0aa3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdde5ec7-c70e-49ff-ab41-0564bb151505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdde5ec7-c70e-49ff-ab41-0564bb151505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637266854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3201ac1-6671-4903-8b86-2fd9636e4552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7280f71-89fa-4fc8-a03a-e950a3ba1890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7280f71-89fa-4fc8-a03a-e950a3ba1890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c42c837-6671-45d3-9cce-595d4adc047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c42c837-6671-45d3-9cce-595d4adc047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3201ac1-6671-4903-8b86-2fd9636e4552', 'volume_name': 'volume-c3201ac1-6671-4903-8b86-2fd9636e4552', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e497637-f7f4-460a-b5fd-eee55eb0208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e497637-f7f4-460a-b5fd-eee55eb0208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2da6c4-d4dc-489e-a815-6bae89fa52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume c3201ac1-6671-4903-8b86-2fd9636e4552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3201ac1-6671-4903-8b86-2fd9636e4552', 'volume_size': 1} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "cinder-312937a1-e359-4f39-a080-f5b3751b9257-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "cinder-312937a1-e359-4f39-a080-f5b3751b9257-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (513807b9-a667-4fcb-b300-a44f79a43a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdddaf27-6776-48ca-94d5-f97853127b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdddaf27-6776-48ca-94d5-f97853127b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823590511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62b891b-6ec0-4477-9e56-fb0d832f32c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86eef3e-6ae2-42af-b99d-b13e1ab22caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86eef3e-6ae2-42af-b99d-b13e1ab22caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca5463-7ef9-472a-8737-c7dde29b48ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca5463-7ef9-472a-8737-c7dde29b48ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62b891b-6ec0-4477-9e56-fb0d832f32c7', 'volume_name': 'volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6195a99-f69e-4072-a0ff-0fbc796001e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6195a99-f69e-4072-a0ff-0fbc796001e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61015b5-b59d-40a2-89e0-015d68e8979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume d62b891b-6ec0-4477-9e56-fb0d832f32c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7', 'volume_size': 1} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "cinder-quobyte-312937a1-e359-4f39-a080-f5b3751b9257" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "cinder-quobyte-312937a1-e359-4f39-a080-f5b3751b9257" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[867ad858-d9c7-476e-919d-9d99b33a5585]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (a541f1da-8388-4d20-85f0-479144d0380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94bc52d-b8fd-4562-a6ec-491deb7875c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94bc52d-b8fd-4562-a6ec-491deb7875c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-577895400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27d8708-cd60-4445-8af8-83fc5a33926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e894b065-0e37-4a39-9035-0e7c12789761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e894b065-0e37-4a39-9035-0e7c12789761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96deadd-69d8-41e3-ac7c-75c0e60fba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96deadd-69d8-41e3-ac7c-75c0e60fba2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27d8708-cd60-4445-8af8-83fc5a33926c', 'volume_name': 'volume-e27d8708-cd60-4445-8af8-83fc5a33926c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba2c586-1fc2-4505-96cc-c2dec1a8a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba2c586-1fc2-4505-96cc-c2dec1a8a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5da02-5de7-42af-aa63-283bab6d9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume e27d8708-cd60-4445-8af8-83fc5a33926c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27d8708-cd60-4445-8af8-83fc5a33926c', 'volume_size': 1} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c 1073741824" returned: 0 in 0.990s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:15 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 Apr 08 17:41:15 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:15 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:15 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c Apr 08 17:41:15 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (e43177a2-3a94-43f3-a0b7-7eda7a242a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed70a916-c1bb-485b-99bf-9224b45aee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" returned: 0 in 1.049s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed70a916-c1bb-485b-99bf-9224b45aee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026366764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f454a67c-fa59-4856-8b47-47429dc650a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:16Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febc3d65-c745-4c72-8fc4-0f7635f840b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febc3d65-c745-4c72-8fc4-0f7635f840b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa9296d-d481-4149-9d51-7313ffa23cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa9296d-d481-4149-9d51-7313ffa23cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f454a67c-fa59-4856-8b47-47429dc650a3', 'volume_name': 'volume-f454a67c-fa59-4856-8b47-47429dc650a3', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff925bb9-f4f3-4f48-947b-e627332989e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff925bb9-f4f3-4f48-947b-e627332989e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3650c4-4935-472a-a88f-84e5d870154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume f454a67c-fa59-4856-8b47-47429dc650a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f454a67c-fa59-4856-8b47-47429dc650a3', 'volume_size': 1} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc" released by "delete_volume" :: held 1.828s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Created reservations ['0ddb961f-c14f-41e1-aab0-e2badfe0c911', '9b49396b-8b2f-4388-8b53-3f2560155934', 'd6c0753b-60d9-4868-bfa4-2448baaf5543', '43330262-a12a-4418-bb21-3dd333a879cf'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:15 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:15 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:16 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257" returned: 0 in 0.654s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:16 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257 Apr 08 17:41:16 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:16 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637266854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3201ac1-6671-4903-8b86-2fd9636e4552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume c3201ac1-6671-4903-8b86-2fd9636e4552 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:16 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bca584d-d6b7-402e-b62f-96a0a754ec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e96937-fa2a-4e20-8469-418b34bf5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:16 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 1073741824 Apr 08 17:41:16 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:16 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c (5ced2fcd-6e68-4373-9fdd-28cd729d0d7c): created successfully Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e96937-fa2a-4e20-8469-418b34bf5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (4d9026b2-ab3f-4878-bde7-4f647ce636a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ec706dd3-0ec3-4abb-9fe9-e4861a4d4dd1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:16 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c6638eb-4ce5-47d2-8b7b-42f0a1262105 tempest-VolumesGetTest-117147952 None] Lock "cinder-5a5ab9f4-80c0-4f89-8f24-cec5e7bb41cc-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:16 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-312937a1-e359-4f39-a080-f5b3751b9257" returned: 0 in 0.687s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "cinder-quobyte-312937a1-e359-4f39-a080-f5b3751b9257" released by "delete_volume" :: held 1.373s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Created reservations ['afa746b2-735c-4870-8f58-e613bd437055', '68271e94-40f3-4584-a64f-02abfcbfe0c5', 'c09f1a17-7c44-4437-9c14-c8a6fe29f1e0', '08ae316e-fe3d-4242-9c06-6144151021d3'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:16 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:16 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (8d352cc4-a61e-4779-b971-2830b3934a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70279eb9-2153-471a-940f-e6f05bd3aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70279eb9-2153-471a-940f-e6f05bd3aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2035393032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9447823f-f713-45e6-b3e7-4151c75c2bc6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:17Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c80eab-9363-45b0-b668-b66faefcb39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c80eab-9363-45b0-b668-b66faefcb39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e6395-990a-4f0c-a8c2-5538830fdd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG cinder.image.glance [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Creating Keystone auth plugin from conf {{(pid=82664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 08 17:41:16 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 1073741824" returned: 0 in 0.800s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:16 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 Apr 08 17:41:16 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1e6395-990a-4f0c-a8c2-5538830fdd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9447823f-f713-45e6-b3e7-4151c75c2bc6', 'volume_name': 'volume-9447823f-f713-45e6-b3e7-4151c75c2bc6', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606523ee-a18b-4670-8416-a7c11a93d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606523ee-a18b-4670-8416-a7c11a93d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fe7207-5529-4767-bbdd-e73bd7b41ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:17 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Volume 9447823f-f713-45e6-b3e7-4151c75c2bc6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9447823f-f713-45e6-b3e7-4151c75c2bc6', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Trying to clone 9447823f-f713-45e6-b3e7-4151c75c2bc6 from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]). {{(pid=82664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 08 17:41:17 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Image download 20.69 MB at 20.69 MB/s Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8582d90d-5d08-442e-a2aa-7a9dbc3e4834]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:17 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.828s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Deleted volume successfully. Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-591abd7b-940f-417d-ba5f-29e857bf8ccd tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "cinder-312937a1-e359-4f39-a080-f5b3751b9257-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:17 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD Apr 08 17:41:17 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:17 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552" returned: 0 in 1.078s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823590511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62b891b-6ec0-4477-9e56-fb0d832f32c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume d62b891b-6ec0-4477-9e56-fb0d832f32c7 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:18 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2da6c4-d4dc-489e-a815-6bae89fa52af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3201ac1-6671-4903-8b86-2fd9636e4552', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8821a291-755b-460a-949c-b4dd6f1efbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 1073741824 Apr 08 17:41:18 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:18 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-c3201ac1-6671-4903-8b86-2fd9636e4552 (c3201ac1-6671-4903-8b86-2fd9636e4552): created successfully Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8821a291-755b-460a-949c-b4dd6f1efbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (92202ed7-3453-40dc-a269-e520c0aa3955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-089caf74-33b8-4985-b854-652cad74da76 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Flow 'volume_create_manager' (1392521b-5343-431f-ac47-9416452cc875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aa438b-ae40-4c89-9c8b-a073601ca258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3aa438b-ae40-4c89-9c8b-a073601ca258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1170913515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c43e4b2-d0e2-4f0b-a89f-ea858b754f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ae519a4b3a4588a8c6a403e286d411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:18Z,use_quota=True,user_id='b6f93d8767794013b7950538f18d0fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195be0a-f4ed-4aa9-8c7d-6fc3ee98d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9195be0a-f4ed-4aa9-8c7d-6fc3ee98d512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d5c21f-7da8-4db7-bc96-9f5535dbb8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d5c21f-7da8-4db7-bc96-9f5535dbb8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c43e4b2-d0e2-4f0b-a89f-ea858b754f39', 'volume_name': 'volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bc9389-f27c-4b6a-81ee-7949679e22e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bc9389-f27c-4b6a-81ee-7949679e22e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbb89e3-87d2-4373-9af3-abe03bdc2e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:18 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume 0c43e4b2-d0e2-4f0b-a89f-ea858b754f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39', 'volume_size': 1} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:18 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 is fetched for user 42695637eba74de6a86925d2b7253fcf. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df4ae34-1d41-42fd-ac87-4f700a464c75]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:18 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD Apr 08 17:41:18 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:19 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 1073741824" returned: 0 in 1.089s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:19 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 Apr 08 17:41:19 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:19 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:19 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7" returned: 0 in 0.593s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.164s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-577895400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27d8708-cd60-4445-8af8-83fc5a33926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:15Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume e27d8708-cd60-4445-8af8-83fc5a33926c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:19 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61015b5-b59d-40a2-89e0-015d68e8979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:19 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c 1073741824 Apr 08 17:41:19 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b025eb9-b18b-4410-a9e2-ed0cd60d13d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:19 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 (d62b891b-6ec0-4477-9e56-fb0d832f32c7): created successfully Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b025eb9-b18b-4410-a9e2-ed0cd60d13d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (513807b9-a667-4fcb-b300-a44f79a43a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7081543c-f403-4153-b01c-70d9c1228f58 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:20 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c 1073741824" returned: 0 in 0.577s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:20 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c Apr 08 17:41:20 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:20 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c" returned: 0 in 0.493s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.160s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026366764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f454a67c-fa59-4856-8b47-47429dc650a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747d438e1a0542609d0a36dcf861f171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:16Z,use_quota=True,user_id='17fca9dddb2b4daeb815f48695e4ff07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Creating volume f454a67c-fa59-4856-8b47-47429dc650a3 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:20 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5da02-5de7-42af-aa63-283bab6d9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27d8708-cd60-4445-8af8-83fc5a33926c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41982606-623b-4546-91b7-3970bba70305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:20 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 1073741824 Apr 08 17:41:20 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-e27d8708-cd60-4445-8af8-83fc5a33926c (e27d8708-cd60-4445-8af8-83fc5a33926c): created successfully Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41982606-623b-4546-91b7-3970bba70305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (a541f1da-8388-4d20-85f0-479144d0380e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c9670cd2-e6de-4b73-81de-4bd1d9fe5335 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:21 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 1073741824" returned: 0 in 0.590s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:21 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 Apr 08 17:41:21 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:21 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3" returned: 0 in 0.528s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1170913515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c43e4b2-d0e2-4f0b-a89f-ea858b754f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ae519a4b3a4588a8c6a403e286d411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:18Z,use_quota=True,user_id='b6f93d8767794013b7950538f18d0fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Creating volume 0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:22 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3650c4-4935-472a-a88f-84e5d870154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f454a67c-fa59-4856-8b47-47429dc650a3', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:22 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 1073741824 Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbb10de-143c-4b21-a9aa-42968378751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:22 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:22 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Volume volume-f454a67c-fa59-4856-8b47-47429dc650a3 (f454a67c-fa59-4856-8b47-47429dc650a3): created successfully Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbb10de-143c-4b21-a9aa-42968378751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Flow 'volume_create_manager' (e43177a2-3a94-43f3-a0b7-7eda7a242a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-66d436a0-463b-4b44-8f9e-1aac4b2a3e0f tempest-CreateVolumesFromSnapshotTest-694161594 None] Created volume successfully. Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-f454a67c-fa59-4856-8b47-47429dc650a3-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-f454a67c-fa59-4856-8b47-47429dc650a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-f454a67c-fa59-4856-8b47-47429dc650a3" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f454a67c-fa59-4856-8b47-47429dc650a3" acquired by "delete_volume" :: waited 0.033s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a00ff1-c95e-434b-b118-1002927a406c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:22 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 Apr 08 17:41:22 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:22 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 1073741824" returned: 0 in 0.737s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:22 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 Apr 08 17:41:22 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:23 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3" returned: 0 in 0.830s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:23 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3 Apr 08 17:41:23 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:23 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" returned: 0 in 0.661s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.172s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2035393032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9447823f-f713-45e6-b3e7-4151c75c2bc6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:17Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Creating volume 9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:23 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbb89e3-87d2-4373-9af3-abe03bdc2e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f5e8d-8037-4ad6-b140-3d24056a7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:23 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1073741824 Apr 08 17:41:23 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:23 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Volume volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 (0c43e4b2-d0e2-4f0b-a89f-ea858b754f39): created successfully Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f5e8d-8037-4ad6-b140-3d24056a7d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Flow 'volume_create_manager' (1392521b-5343-431f-ac47-9416452cc875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-992af535-67ec-471f-a96f-92a22809717b tempest-VolumeQuotasAdminTestJSON-58712098 None] Created volume successfully. Apr 08 17:41:23 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f454a67c-fa59-4856-8b47-47429dc650a3" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f454a67c-fa59-4856-8b47-47429dc650a3" released by "delete_volume" :: held 1.442s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['28a863e9-2753-4cee-9042-fbcb75f8bcfa', '7b30d72c-e236-46b9-861f-453e5d6ac3a3', 'bb8c27d4-65f9-4577-9eaf-8dbac2396371', 'e0a7bdfd-7e09-47c7-9ecb-e082d0afffe0'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:24 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:24 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:24 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1073741824" returned: 0 in 0.642s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:24 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:24 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:24 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7274e657-c3a4-4df2-9d01-7ceac023ba55 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-f454a67c-fa59-4856-8b47-47429dc650a3-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Acquiring lock "cinder-3857767a-9bdb-4fcc-bdfc-51f83b2a466b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "cinder-3857767a-9bdb-4fcc-bdfc-51f83b2a466b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Acquiring lock "cinder-quobyte-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "cinder-quobyte-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a4691-e849-47a9-9d29-572913cdbeec]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-e27d8708-cd60-4445-8af8-83fc5a33926c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-e27d8708-cd60-4445-8af8-83fc5a33926c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:24 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 0 in 0.687s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Attempting download of 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 9447823f-f713-45e6-b3e7-4151c75c2bc6. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-e27d8708-cd60-4445-8af8-83fc5a33926c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:24 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b Apr 08 17:41:24 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-e27d8708-cd60-4445-8af8-83fc5a33926c" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50680d5-a894-4c60-bc31-018388e68963]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fe1b4-3604-4632-aaf9-145d38dd2762]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:25 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c Apr 08 17:41:25 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:25 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n Apr 08 17:41:25 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:25 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" returned: 0 in 0.828s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:25 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b Apr 08 17:41:25 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=117,cinder:UPDATE=150,cinder:INSERT=43,cinder:DELETE=10 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:41:25 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-32fb7158-533a-4ea5-aa60-130d978e5204 tempest-VolumeQuotasAdminTestJSON-307165623 None] Transfer volume completed successfully. Apr 08 17:41:25 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c" returned: 0 in 0.879s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:25 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c Apr 08 17:41:25 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:25 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n" returned: 0 in 0.956s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:25 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n Apr 08 17:41:25 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:26 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" returned: 0 in 0.693s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "cinder-quobyte-3857767a-9bdb-4fcc-bdfc-51f83b2a466b" released by "delete_volume" :: held 1.587s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Created reservations ['e20f2451-9eae-4f0a-a8dd-488c7e1d9bbe', '5b84e1a2-70ca-40d2-a291-e5f64af93159', '0f1f2053-4262-4076-81d2-85ece0ef7b53', '2ee94872-fd61-486a-ad0c-c68a2d740445'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:26 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:26 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:26 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n" returned: 1 in 0.763s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_mtjtna4n' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf82999-582a-4cdb-9d45-a3c25987ad66]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:26 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e27d8708-cd60-4445-8af8-83fc5a33926c" returned: 0 in 0.912s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-e27d8708-cd60-4445-8af8-83fc5a33926c" released by "delete_volume" :: held 1.830s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Acquiring lock "cinder-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "cinder-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:26 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD Apr 08 17:41:26 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Acquiring lock "cinder-quobyte-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['e0baf4a1-65e4-43d9-b00b-7d4198a8d711', 'bf161b41-9280-4510-bf46-4ada6bc4547c', 'a90f757d-6964-48fd-bd33-d20c7d9c2915', '6d57bc05-202e-426b-b200-6e4907e9b4eb'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "cinder-quobyte-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c741d-fbe0-48c5-bd34-bfc2d7c3f4c0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:26 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:26 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:27 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 Apr 08 17:41:27 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-d62b891b-6ec0-4477-9e56-fb0d832f32c7-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-d62b891b-6ec0-4477-9e56-fb0d832f32c7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-d62b891b-6ec0-4477-9e56-fb0d832f32c7" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-d62b891b-6ec0-4477-9e56-fb0d832f32c7" acquired by "delete_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[54216a75-c69d-4f0e-8415-12a9ccf87bba]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:27 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 Apr 08 17:41:27 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:27 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.278s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:27 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Deleted volume successfully. Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0eee02fe-8479-4b8c-875d-cab0c41c06b5 tempest-ServerRescueNegativeTestJSON-1615747022 None] Lock "cinder-3857767a-9bdb-4fcc-bdfc-51f83b2a466b-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:27 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.974s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:27 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f630605c-fbaa-44d3-9da7-492be620688b tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-e27d8708-cd60-4445-8af8-83fc5a33926c-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:28 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD" returned: 0 in 1.476s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 was qcow2, converting to raw {{(pid=82664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:28 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" returned: 0 in 1.237s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:28 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:28 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:28 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39 Apr 08 17:41:28 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:28 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7" returned: 0 in 1.234s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:28 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7 Apr 08 17:41:28 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:28 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" returned: 0 in 0.775s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "cinder-quobyte-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39" released by "delete_volume" :: held 2.047s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:28 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=147,cinder:UPDATE=183,cinder:DELETE=16,cinder:INSERT=33 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Created reservations ['83e7c3e1-628c-4042-9965-e9d4e3efa47f', 'be30ebfd-f457-429f-97a5-57c3e2761d65', '17780123-92a8-4e55-8e03-c2a80f60b247', 'c1650356-fc1c-40e1-98f1-7c9ffbef77ec'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:29 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:29 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:29 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 0 in 1.097s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237_596us3ggdevstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:41:29 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Converted 112.00 MB image at 101.95 MB/s Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:29 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1G Apr 08 17:41:29 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:29 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d62b891b-6ec0-4477-9e56-fb0d832f32c7" returned: 0 in 0.738s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-d62b891b-6ec0-4477-9e56-fb0d832f32c7" released by "delete_volume" :: held 2.060s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['c3797fad-9815-4ee6-800b-f66bdfe528b6', '349c3540-fdd2-4e23-8064-faf89ea26347', '13ae3b22-f439-41cf-8c06-b39190da7faf', '20d40858-2e73-4f82-b696-91e3def74089'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:29 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:29 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:29 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Deleted volume successfully. Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-30520c8c-feb8-46f1-b9a2-5607e505e125 tempest-VolumeQuotasAdminTestJSON-82976118 None] Lock "cinder-0c43e4b2-d0e2-4f0b-a89f-ea858b754f39-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:29 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 1G" returned: 0 in 0.470s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99f50c-0abe-47e3-946d-0fed755de869]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:29 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:29 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:29 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.501s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8133bf82-4878-4b49-bda2-a0968b947a90 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-d62b891b-6ec0-4477-9e56-fb0d832f32c7-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:30 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 0 in 0.623s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:30 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:30 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-c3201ac1-6671-4903-8b86-2fd9636e4552-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-c3201ac1-6671-4903-8b86-2fd9636e4552-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-c3201ac1-6671-4903-8b86-2fd9636e4552" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-c3201ac1-6671-4903-8b86-2fd9636e4552" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea98c11-cd80-437c-a400-3c058de99055]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:30 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 Apr 08 17:41:30 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:31 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 1 in 0.704s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Downloaded image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}])) to volume 9447823f-f713-45e6-b3e7-4151c75c2bc6 successfully. {{(pid=82664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Temporary image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 for user 42695637eba74de6a86925d2b7253fcf is deleted. {{(pid=82664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.volume_utils [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Marking volume 9447823f-f713-45e6-b3e7-4151c75c2bc6 as bootable. {{(pid=82664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Copying metadata from image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 to 9447823f-f713-45e6-b3e7-4151c75c2bc6. {{(pid=82664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Creating volume glance metadata for volume 9447823f-f713-45e6-b3e7-4151c75c2bc6 backed by image 5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fe7207-5529-4767-bbdd-e73bd7b41ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9447823f-f713-45e6-b3e7-4151c75c2bc6', 'volume_size': 1, 'image_id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb27634514ca4f1fae736e2cfe5e64a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237', 'created_at': datetime.datetime(2026, 4, 8, 15, 32, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 15, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f8ec70e-0b5a-4a8e-9f63-5e57a39a9237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d59d46-ca5a-4ac4-9f0b-a6be183fea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:31 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Volume volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 (9447823f-f713-45e6-b3e7-4151c75c2bc6): created successfully Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d59d46-ca5a-4ac4-9f0b-a6be183fea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (8d352cc4-a61e-4779-b971-2830b3934a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-adec1402-c8a0-4e57-8d18-d60b5c090c9d tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:41:31 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:31 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552 Apr 08 17:41:31 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:31 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c3201ac1-6671-4903-8b86-2fd9636e4552" returned: 0 in 0.606s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-c3201ac1-6671-4903-8b86-2fd9636e4552" released by "delete_volume" :: held 1.221s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['80c49cd1-51f9-4a93-995d-c9322ade536c', '1d5be7a2-24b8-456c-b48a-bd7d143971d8', '1d70e023-1a79-4352-96c8-7a7615f8b9ab', 'ed75c85d-9df2-47ab-8690-77c949c662ca'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:32 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:32 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:32 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.571s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:32 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-dbb2d3a3-37b7-411c-af29-e0b380a2f0d1 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-c3201ac1-6671-4903-8b86-2fd9636e4552-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (450d3d8a-37ca-4e44-aa09-fe1941482898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc04870-0ed8-448c-bc34-a79ef31a569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc04870-0ed8-448c-bc34-a79ef31a569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667673724',display_name='tempest-VolumesGetTest-Volume-1201577060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d0751-fe78-4339-9601-93cfc40bcea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:33Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bbc498-1bcd-4e17-b021-112801415fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bbc498-1bcd-4e17-b021-112801415fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270a3fd1-6539-4612-8748-d854ba171e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270a3fd1-6539-4612-8748-d854ba171e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983d0751-fe78-4339-9601-93cfc40bcea8', 'volume_name': 'volume-983d0751-fe78-4339-9601-93cfc40bcea8', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9025edd2-0db9-49a8-8d01-7c4afe71bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9025edd2-0db9-49a8-8d01-7c4afe71bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d5e30-e03a-48bb-beea-e3776d12d961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:32 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Volume 983d0751-fe78-4339-9601-93cfc40bcea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983d0751-fe78-4339-9601-93cfc40bcea8', 'volume_size': 1} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667673724',display_name='tempest-VolumesGetTest-Volume-1201577060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d0751-fe78-4339-9601-93cfc40bcea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33690f750154437ebc45feedf8332d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:33Z,use_quota=True,user_id='42695637eba74de6a86925d2b7253fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Creating volume 983d0751-fe78-4339-9601-93cfc40bcea8 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:32 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:32 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 1073741824 Apr 08 17:41:32 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f2d0e-eb39-4fb4-8fc9-a54679b59eb8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:32 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c Apr 08 17:41:32 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:33 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 1073741824" returned: 0 in 0.586s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:33 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 Apr 08 17:41:33 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:33 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" returned: 0 in 0.638s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:33 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c Apr 08 17:41:33 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:34 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8" returned: 0 in 0.696s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d5e30-e03a-48bb-beea-e3776d12d961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983d0751-fe78-4339-9601-93cfc40bcea8', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ea1a39-4744-453b-a00b-d94efc6973ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:34 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Volume volume-983d0751-fe78-4339-9601-93cfc40bcea8 (983d0751-fe78-4339-9601-93cfc40bcea8): created successfully Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ea1a39-4744-453b-a00b-d94efc6973ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Flow 'volume_create_manager' (450d3d8a-37ca-4e44-aa09-fe1941482898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-19406c1f-2b67-4c99-8407-b06bfcb1b401 tempest-VolumesGetTest-117147952 None] Created volume successfully. Apr 08 17:41:34 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" returned: 0 in 0.805s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c" released by "delete_volume" :: held 1.477s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['f8e167f8-4ba7-4270-8c43-05622ca70053', '977ed1c9-fde7-43c9-b535-776f2e0a2b0f', 'b0733b1b-1c64-4789-9d12-a050012c16f2', 'd7bf18ba-1460-4e3c-88e5-387bb09eab9c'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:34 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:34 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:34 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.531s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7a0d1d82-0052-4e33-b9ff-ac3966a48148 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-5ced2fcd-6e68-4373-9fdd-28cd729d0d7c-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-983d0751-fe78-4339-9601-93cfc40bcea8-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "cinder-983d0751-fe78-4339-9601-93cfc40bcea8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-b881fe7a-c141-4474-be44-590f9fecde5c-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-983d0751-fe78-4339-9601-93cfc40bcea8" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-b881fe7a-c141-4474-be44-590f9fecde5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-983d0751-fe78-4339-9601-93cfc40bcea8" acquired by "delete_volume" :: waited 0.036s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[747f4104-2de0-4ff8-815e-3ca23d9f8e13]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" acquired by "delete_snapshot" :: waited 0.091s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-b881fe7a-c141-4474-be44-590f9fecde5c" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Flow 'volume_create_manager' (a63d3891-4fe1-4ac3-b481-adce48575f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2ee058-2ac8-47a0-a7ad-07f64d7688ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2ee058-2ac8-47a0-a7ad-07f64d7688ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-392988071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b00c65-8c9d-482c-8cdc-b3eec76b5a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5041287854c141bb840a605936da1ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:35Z,use_quota=True,user_id='da6b4f0217ad4b2c9f8ae4e8395d029c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ffbf02-abd3-4124-9fa1-69f3db245315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ffbf02-abd3-4124-9fa1-69f3db245315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:35 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 Apr 08 17:41:35 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001941d3-0931-4289-b0ff-e3fb9514acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001941d3-0931-4289-b0ff-e3fb9514acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b00c65-8c9d-482c-8cdc-b3eec76b5a26', 'volume_name': 'volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372b3f5-524d-4b3d-b1fe-e766344410c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372b3f5-524d-4b3d-b1fe-e766344410c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218e6ab-0823-4332-afa2-3a1830a279b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:35 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Volume a0b00c65-8c9d-482c-8cdc-b3eec76b5a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26', 'volume_size': 1} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-392988071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b00c65-8c9d-482c-8cdc-b3eec76b5a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5041287854c141bb840a605936da1ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:35Z,use_quota=True,user_id='da6b4f0217ad4b2c9f8ae4e8395d029c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Creating volume a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:35 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-b881fe7a-c141-4474-be44-590f9fecde5c" acquired by "_delete_snapshot" :: waited 0.138s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleting offline snapshot b881fe7a-c141-4474-be44-590f9fecde5c of volume f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] snapshot_file for this snap is: volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd827231-130c-4673-a5e5-898885b337f2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:35 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 1073741824 Apr 08 17:41:35 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:35 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c Apr 08 17:41:35 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:35 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8" returned: 0 in 0.562s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:35 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8 Apr 08 17:41:35 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:35 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 1073741824" returned: 0 in 0.591s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:35 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c" returned: 0 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1c5c731-7fa9-4830-b383-5bed7d457562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1955ad-247c-41ad-a97a-11fbca0b4b56]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:36 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 Apr 08 17:41:36 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:36 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 Apr 08 17:41:36 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:36 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-983d0751-fe78-4339-9601-93cfc40bcea8" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-983d0751-fe78-4339-9601-93cfc40bcea8" released by "delete_volume" :: held 1.129s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Created reservations ['fc8b9f27-3a2b-4355-92ae-6d6d74ee7d8d', '09f252d4-add1-482e-8335-2182175ed2a4', '972890ec-edf4-479e-91c0-74803fcc135a', '30725836-08cc-4d3c-aafb-74d35d41337d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:36 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:36 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:36 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218e6ab-0823-4332-afa2-3a1830a279b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:36 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83bf45-a80f-41ce-9c10-06169bbe364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562" returned: 0 in 0.540s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:36 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Volume volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 (a0b00c65-8c9d-482c-8cdc-b3eec76b5a26): created successfully Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec83bf45-a80f-41ce-9c10-06169bbe364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Flow 'volume_create_manager' (a63d3891-4fe1-4ac3-b481-adce48575f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1cb64574-1ff7-44f8-872f-6bb3e5ac0fc2 tempest-VolumesServicesTestJSON-2037221089 None] Created volume successfully. Apr 08 17:41:36 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c Apr 08 17:41:36 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:36 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:41:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0518549f-01ff-442f-96e0-35eb6b43ad54 tempest-VolumesGetTest-117147952 None] Lock "cinder-983d0751-fe78-4339-9601-93cfc40bcea8-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:37 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c" returned: 0 in 0.529s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:37 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c Apr 08 17:41:37 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-9447823f-f713-45e6-b3e7-4151c75c2bc6-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "cinder-9447823f-f713-45e6-b3e7-4151c75c2bc6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Acquiring lock "cinder-quobyte-9447823f-f713-45e6-b3e7-4151c75c2bc6" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-9447823f-f713-45e6-b3e7-4151c75c2bc6" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b8f30-4584-4871-a8a8-92e8ae8cea27]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Acquiring lock "cinder-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "cinder-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:37 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:37 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Acquiring lock "cinder-quobyte-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "cinder-quobyte-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2558f435-984b-4dee-9f26-59ec3d37e851]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:37 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562.b881fe7a-c141-4474-be44-590f9fecde5c" returned: 0 in 0.472s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-b881fe7a-c141-4474-be44-590f9fecde5c" released by "_delete_snapshot" :: held 2.174s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" released by "delete_snapshot" :: held 2.318s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:37 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 Apr 08 17:41:37 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['653ed34b-e964-4e44-aec2-ca61dfa43817', '9d52d450-bcea-4f0e-b6c7-3178eeba2ca5', 'dae04f78-5c2c-42d5-bd4e-e369cb2360c5', 'fc2a66ce-84cf-4b8f-8d93-db2223220b01'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:37 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Delete snapshot completed successfully. Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-183a0089-7081-4f4d-803d-0f1342e8ab25 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-b881fe7a-c141-4474-be44-590f9fecde5c-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:37 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:37 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" returned: 0 in 0.454s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:37 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26 Apr 08 17:41:37 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:38 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-f1c5c731-7fa9-4830-b383-5bed7d457562-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-f1c5c731-7fa9-4830-b383-5bed7d457562-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfda549-d3cf-49f0-8eda-c67ca4e63a63]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:38 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:38 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 Apr 08 17:41:38 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "cinder-quobyte-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26" released by "delete_volume" :: held 0.925s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Created reservations ['c6c8d6df-7f92-48ae-80dd-beab9c30507c', 'ffba0b4d-ad35-42de-938a-61d61564bf65', 'f436bda1-86c4-4498-aedd-04261f0aa206', '2ed0df0a-c57e-4372-bb42-cd3f2a213b31'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:38 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 1 in 0.559s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:38 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:38 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6 Apr 08 17:41:38 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562" returned: 0 in 0.617s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:38 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562 Apr 08 17:41:38 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:38 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:38 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:38 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Deleted volume successfully. Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e13a086b-89f3-4ce8-aaf3-cbac1e077b3f tempest-VolumesServicesTestJSON-2037221089 None] Lock "cinder-a0b00c65-8c9d-482c-8cdc-b3eec76b5a26-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:39 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9447823f-f713-45e6-b3e7-4151c75c2bc6" returned: 0 in 0.559s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "cinder-quobyte-9447823f-f713-45e6-b3e7-4151c75c2bc6" released by "delete_volume" :: held 1.725s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Created reservations ['57c66858-cac2-43fb-bd7a-60e8f62a1dde', 'b1d09374-73f4-4beb-b5dc-537ccfd51d30', '2e50b3da-a2b1-4aa7-8feb-2cf13f200d79', '6eb7c018-bb93-4f64-a402-1ec761e3529c'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:39 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:39 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:39 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f1c5c731-7fa9-4830-b383-5bed7d457562" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-quobyte-f1c5c731-7fa9-4830-b383-5bed7d457562" released by "delete_volume" :: held 1.141s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Created reservations ['b066cbdf-1798-4266-a154-7b5ac67991df', '62d3763b-7b69-48e3-a7dd-185d38b6077b', '19115cde-cb2d-4a28-aa13-143c63de29c2', '5c39b686-8c6e-47af-ab3c-12c15cb7f793'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:39 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:41:39 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:39 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.497s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Deleted volume successfully. Apr 08 17:41:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-96cca391-a88e-4c86-9228-bf5990e7ae1e tempest-VolumesGetTest-117147952 None] Lock "cinder-9447823f-f713-45e6-b3e7-4151c75c2bc6-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:40 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.546s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:40 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:41:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Deleted volume successfully. Apr 08 17:41:40 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8a6249b-300e-4b12-8b69-7a14bb5be4f7 tempest-CreateVolumesFromSnapshotTest-694161594 None] Lock "cinder-f1c5c731-7fa9-4830-b383-5bed7d457562-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (a596a6fa-e4fd-4e65-aaa1-0d42dfd6886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f3bfe1-98b9-4036-9161-5e954d0817c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f3bfe1-98b9-4036-9161-5e954d0817c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-399967284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d384ed31-00a2-4c03-90fd-695497c533d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:43Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4848375-be53-4f5d-8fff-6429eb6fd08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4848375-be53-4f5d-8fff-6429eb6fd08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff95780-ec04-4dc6-abec-d19b0ce09b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff95780-ec04-4dc6-abec-d19b0ce09b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd384ed31-00a2-4c03-90fd-695497c533d2', 'volume_name': 'volume-d384ed31-00a2-4c03-90fd-695497c533d2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6a99e-ddbd-46e5-bf66-119ee7591c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6a99e-ddbd-46e5-bf66-119ee7591c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19970d09-566e-43fe-a252-74de4bf67f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:42 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Volume d384ed31-00a2-4c03-90fd-695497c533d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d384ed31-00a2-4c03-90fd-695497c533d2', 'volume_size': 1} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-399967284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d384ed31-00a2-4c03-90fd-695497c533d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:43Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Creating volume d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:42 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:42 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 1073741824 Apr 08 17:41:42 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:43 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 1073741824" returned: 0 in 0.525s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:43 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:43 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:43 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19970d09-566e-43fe-a252-74de4bf67f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d384ed31-00a2-4c03-90fd-695497c533d2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ddecf-488e-4f8e-92d8-968132fc136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Volume volume-d384ed31-00a2-4c03-90fd-695497c533d2 (d384ed31-00a2-4c03-90fd-695497c533d2): created successfully Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ddecf-488e-4f8e-92d8-968132fc136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (a596a6fa-e4fd-4e65-aaa1-0d42dfd6886b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-95dd9289-af09-4df5-a390-8561f74918b5 tempest-VolumeDependencyTests-682601165 None] Created volume successfully. Apr 08 17:41:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Creating offline snapshot 0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 of volume d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:41:44 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f306acf8-51d0-4f58-af21-434ebada2a8a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:44 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:44 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:45 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.621s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:45 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 1G Apr 08 17:41:45 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:45 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 1G" returned: 0 in 0.519s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d384ed31-00a2-4c03-90fd-695497c533d2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:45 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d384ed31-00a2-4c03-90fd-695497c533d2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:45 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:46 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d384ed31-00a2-4c03-90fd-695497c533d2 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:46 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 is being set with open permissions: ugo+rw Apr 08 17:41:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:46 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:46 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:47 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:47 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info Apr 08 17:41:47 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:47 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info" returned: 0 in 0.615s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:47 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info is being set with open permissions: ugo+rw Apr 08 17:41:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:47 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info Apr 08 17:41:47 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:48 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.info" returned: 0 in 0.642s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.566s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d608dbb9-fe6d-401c-9519-a3f0f69e2c28 tempest-VolumeDependencyTests-682601165 None] Create snapshot completed successfully Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (4d8bbb84-a094-43cc-9dc5-6e225331a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0556de50-9b31-452c-ac95-718944d585b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0556de50-9b31-452c-ac95-718944d585b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2009273104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78383b78-39b2-4b89-bdc1-ca3c62745e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:49Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d634fec-59c3-4d5a-aa70-be697fbe1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d634fec-59c3-4d5a-aa70-be697fbe1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231244e0-907d-421a-b41e-ac158a25f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231244e0-907d-421a-b41e-ac158a25f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78383b78-39b2-4b89-bdc1-ca3c62745e59', 'volume_name': 'volume-78383b78-39b2-4b89-bdc1-ca3c62745e59', 'volume_size': 1, 'snapshot_id': '0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfab2d2-35cf-4129-b6d0-8ed339477313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfab2d2-35cf-4129-b6d0-8ed339477313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c68c5-effc-4ade-940d-866857e86894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:49 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Volume 78383b78-39b2-4b89-bdc1-ca3c62745e59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78383b78-39b2-4b89-bdc1-ca3c62745e59', 'volume_size': 1, 'snapshot_id': '0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142'} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-78383b78-39b2-4b89-bdc1-ca3c62745e59" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-78383b78-39b2-4b89-bdc1-ca3c62745e59" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Creating volume 78383b78-39b2-4b89-bdc1-ca3c62745e59 from snapshot 0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] snapshot: 0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142, volume: 78383b78-39b2-4b89-bdc1-ca3c62745e59, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea7e336-c66a-4107-930a-2b0578e39ced]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:49 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:49 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:50 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.582s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d384ed31-00a2-4c03-90fd-695497c533d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b64c00e-9b7f-4c5e-9657-ddd7b552dbf0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:50 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:50 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:50 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.653s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:41:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:50 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 Apr 08 17:41:50 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (99e61dd1-58f4-48b6-9f95-a6350d5b0c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47d1d9-fef0-43df-9670-c742770ae843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f47d1d9-fef0-43df-9670-c742770ae843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1888254882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c39d4e2-7697-47bd-a1b2-a201c4f5bf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:51Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f477f2-e027-4d5a-95a3-20e94e8e80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f477f2-e027-4d5a-95a3-20e94e8e80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799bfb45-17f0-47d3-8988-fd654cbc60c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799bfb45-17f0-47d3-8988-fd654cbc60c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c39d4e2-7697-47bd-a1b2-a201c4f5bf46', 'volume_name': 'volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc297e8c-9a77-46d8-ac11-97ac8a5eac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc297e8c-9a77-46d8-ac11-97ac8a5eac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281dfd6-8ad2-4be3-8077-32e7b3dd32bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:51 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Volume 7c39d4e2-7697-47bd-a1b2-a201c4f5bf46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46', 'volume_size': 1} Apr 08 17:41:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:53 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59" returned: 0 in 2.434s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce54e768-f60a-4348-8b2e-c38b13af3c80]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:53 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:53 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:54 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.842s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:41:54 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Converted 1024.00 MB image at 420.33 MB/s Apr 08 17:41:54 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 is being set with open permissions: ugo+rw Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:54 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 Apr 08 17:41:54 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:54 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59" returned: 0 in 0.548s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" released by "_copy_volume_from_snapshot" :: held 5.149s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-78383b78-39b2-4b89-bdc1-ca3c62745e59" released by "_create_volume_from_snapshot" :: held 5.165s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.174s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.360s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1888254882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c39d4e2-7697-47bd-a1b2-a201c4f5bf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:41:51Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Creating volume 7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:41:54 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:54 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 1073741824 Apr 08 17:41:54 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533c68c5-effc-4ade-940d-866857e86894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78383b78-39b2-4b89-bdc1-ca3c62745e59', 'volume_size': 1, 'snapshot_id': '0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8841b236-1df9-461d-a4c1-7be6f70f0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:54 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Volume volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 (78383b78-39b2-4b89-bdc1-ca3c62745e59): created successfully Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8841b236-1df9-461d-a4c1-7be6f70f0d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (4d8bbb84-a094-43cc-9dc5-6e225331a94f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:54 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-46c839e4-07e1-4e47-bd23-045233e15deb tempest-VolumeDependencyTests-682601165 None] Created volume successfully. Apr 08 17:41:55 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 1073741824" returned: 0 in 0.570s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:55 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 Apr 08 17:41:55 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:55 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" returned: 0 in 0.556s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a281dfd6-8ad2-4be3-8077-32e7b3dd32bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd001639-ace8-4796-be4d-e60dfa4d4b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:55 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Volume volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 (7c39d4e2-7697-47bd-a1b2-a201c4f5bf46): created successfully Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd001639-ace8-4796-be4d-e60dfa4d4b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (99e61dd1-58f4-48b6-9f95-a6350d5b0c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:41:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-482ceb83-647d-4ea3-9f4b-5d7d0be07e65 tempest-VolumesSnapshotTestJSON-407727143 None] Created volume successfully. Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Deleting offline snapshot 0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 of volume d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] snapshot_file for this snap is: volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[133aa5a5-d565-499e-adec-f0199e54ba7a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:55 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:55 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:56 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.686s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d384ed31-00a2-4c03-90fd-695497c533d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84e4d09-f916-49fe-926a-49889d157388]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:56 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:56 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Creating offline snapshot ce3e58b1-254e-4586-b784-88bdf79bbbaa of volume 7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[560bec72-f995-4668-8be2-fca77571ec22]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:57 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 Apr 08 17:41:57 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:57 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.699s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:57 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:57 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:57 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" returned: 0 in 0.558s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:57 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa 1G Apr 08 17:41:57 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:57 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.642s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:57 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142 Apr 08 17:41:57 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:58 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa 1G" returned: 0 in 0.698s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:58 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa Apr 08 17:41:58 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:58 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2.0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" returned: 0 in 0.612s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142" released by "_delete_snapshot" :: held 2.710s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" released by "delete_snapshot" :: held 2.728s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Created reservations ['433e5f90-642d-4582-8056-57fed42583c7', '3e0677ae-1cea-4301-9228-be58eb1bee7d', '2b2a3ac4-f947-4a6e-8b1b-df28313f3a50', 'ca24d5c9-3e87-40aa-acc7-8972e0dc0f34'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:41:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Delete snapshot completed successfully. Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-da3b69d7-ad9c-4994-afbd-3a3b070faa44 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-0b2c041d-cde5-41d8-b4a1-4a2b9ae6f142-delete_snapshot" released by "delete_snapshot" :: held 2.828s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:41:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-d384ed31-00a2-4c03-90fd-695497c533d2-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-d384ed31-00a2-4c03-90fd-695497c533d2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:59 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa" returned: 0 in 0.864s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:59 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa is being set with open permissions: ugo+rw Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:41:59 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa Apr 08 17:41:59 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[03080884-9818-450b-b118-747f7600b504]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:59 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:59 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:59 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa" returned: 0 in 0.750s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:59 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info Apr 08 17:41:59 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:41:59 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.768s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:41:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:41:59 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2 Apr 08 17:41:59 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:00 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info" returned: 0 in 0.565s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:00 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info is being set with open permissions: ugo+rw Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:00 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info Apr 08 17:42:00 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:00 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d384ed31-00a2-4c03-90fd-695497c533d2" returned: 0 in 0.566s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-d384ed31-00a2-4c03-90fd-695497c533d2" released by "delete_volume" :: held 1.385s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Created reservations ['bac3b7ca-b745-40b1-bd49-8fc297ac9434', 'b9e5b3fe-e22c-4514-858f-6d78d8067047', '2a5d6b62-8371-4c79-a9f7-18aabf323c3c', 'af63ab7c-74cc-4df2-beef-d43531862364'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:00 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:00 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:00 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.info" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.065s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7384c7d0-ad6e-43db-8c53-f27369eaddd1 tempest-VolumesSnapshotTestJSON-407727143 None] Create snapshot completed successfully Apr 08 17:42:01 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.560s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Deleted volume successfully. Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-24121c63-d580-4f9a-aec1-de41708ba254 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-d384ed31-00a2-4c03-90fd-695497c533d2-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (8d84f243-7e53-47d2-8275-a177a65c10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c546b94c-2512-4688-8960-615daaf5d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c546b94c-2512-4688-8960-615daaf5d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894408010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e822da-9815-4c0f-bf08-6524c82ccd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:01Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455dfa1c-ba80-4eb0-9c3b-a5a6a7e3c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455dfa1c-ba80-4eb0-9c3b-a5a6a7e3c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f20bdf-19c0-4b4c-aff4-1de982623a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f20bdf-19c0-4b4c-aff4-1de982623a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e822da-9815-4c0f-bf08-6524c82ccd3d', 'volume_name': 'volume-31e822da-9815-4c0f-bf08-6524c82ccd3d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a910eff-000c-436b-8941-5dbecf1ac4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a910eff-000c-436b-8941-5dbecf1ac4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb667f8-a059-4b86-98ab-d3c29efee4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Volume 31e822da-9815-4c0f-bf08-6524c82ccd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e822da-9815-4c0f-bf08-6524c82ccd3d', 'volume_size': 1} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894408010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e822da-9815-4c0f-bf08-6524c82ccd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:01Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Creating volume 31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:01 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:01 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d 1073741824 Apr 08 17:42:01 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-ce3e58b1-254e-4586-b784-88bdf79bbbaa-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-ce3e58b1-254e-4586-b784-88bdf79bbbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:02 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d 1073741824" returned: 0 in 0.662s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-ce3e58b1-254e-4586-b784-88bdf79bbbaa" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:02 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:02 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-ce3e58b1-254e-4586-b784-88bdf79bbbaa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Deleting offline snapshot ce3e58b1-254e-4586-b784-88bdf79bbbaa of volume 7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] snapshot_file for this snap is: volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c3d8d-7e6e-4416-a7f9-77469f2c4671]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:02 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa Apr 08 17:42:02 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:02 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa" returned: 0 in 0.571s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:02 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb9773d-3ced-4fb7-aa29-51f96b00b2fc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.645s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb667f8-a059-4b86-98ab-d3c29efee4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e822da-9815-4c0f-bf08-6524c82ccd3d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf354d2-e772-459b-8419-8264b3043213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:02 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:02 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:02 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Volume volume-31e822da-9815-4c0f-bf08-6524c82ccd3d (31e822da-9815-4c0f-bf08-6524c82ccd3d): created successfully Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf354d2-e772-459b-8419-8264b3043213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (8d84f243-7e53-47d2-8275-a177a65c10f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:03 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-32713b05-b9cf-4685-93dd-6330b71d1045 tempest-VolumeDependencyTests-682601165 None] Created volume successfully. Apr 08 17:42:03 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 Apr 08 17:42:03 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:03 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.479s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:03 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" returned: 0 in 0.641s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:03 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa Apr 08 17:42:03 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (500e9f19-7f0a-4aa8-a6b5-68b6f5e3fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f78efe-6465-4a2f-805c-86153fc81f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f78efe-6465-4a2f-805c-86153fc81f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-196915379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93acab3-2e83-4f6f-8bab-b581ab7081ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79382a1929344482a67177ebf219af11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=31e822da-9815-4c0f-bf08-6524c82ccd3d,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:04Z,use_quota=True,user_id='534647d568b0479a8c4c98cedc16d4cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc5bf71-8397-4821-af42-277d0125d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc5bf71-8397-4821-af42-277d0125d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965982e2-3e80-46ff-91c8-e8dca19a337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965982e2-3e80-46ff-91c8-e8dca19a337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e93acab3-2e83-4f6f-8bab-b581ab7081ff', 'volume_name': 'volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff', 'volume_size': 1, 'source_volid': '31e822da-9815-4c0f-bf08-6524c82ccd3d', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66986942-22f3-44dd-aed7-c1ccc12517b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66986942-22f3-44dd-aed7-c1ccc12517b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c26e06-a923-45a2-ac57-82de8c175411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Volume e93acab3-2e83-4f6f-8bab-b581ab7081ff: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff', 'volume_size': 1, 'source_volid': '31e822da-9815-4c0f-bf08-6524c82ccd3d', 'source_volstatus': 'available'} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:04 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Cloning volume 31e822da-9815-4c0f-bf08-6524c82ccd3d to volume e93acab3-2e83-4f6f-8bab-b581ab7081ff Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Creating offline snapshot a10c8274-399b-40b1-8da2-f3391f03aae9 of volume 31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef919e-f110-4222-8fa4-0509056afa8a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:04 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa" returned: 0 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:04 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa Apr 08 17:42:04 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:04 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:04 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:04 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.543s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:04 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46.ce3e58b1-254e-4586-b784-88bdf79bbbaa" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:04 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 1G Apr 08 17:42:04 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-ce3e58b1-254e-4586-b784-88bdf79bbbaa" released by "_delete_snapshot" :: held 2.345s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" released by "delete_snapshot" :: held 2.358s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['706dc6b1-a4fb-410f-827b-7f242b0e0fbc', '5b405e89-48cd-4c96-b60c-8d7e11090901', '0af1d3c4-08ac-4910-b232-071d26493d3f', '351d302b-18d3-44de-968d-e1c153e11ece'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Delete snapshot completed successfully. Apr 08 17:42:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e71db928-8e7c-4a7c-8d0f-291055422f2c tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-ce3e58b1-254e-4586-b784-88bdf79bbbaa-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:05 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 1G" returned: 0 in 0.631s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e822da-9815-4c0f-bf08-6524c82ccd3d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:05 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e822da-9815-4c0f-bf08-6524c82ccd3d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:05 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:05 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e822da-9815-4c0f-bf08-6524c82ccd3d -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.656s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:05 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 is being set with open permissions: ugo+rw Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (da2f1bb0-81b7-4d3e-bcd0-1c478dd625ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:05 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:05 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9fd85-034b-4bcd-8894-5ec990a22750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9fd85-034b-4bcd-8894-5ec990a22750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642671644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26717ebe-e720-49c5-93b6-b79e75741277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:06Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4295364-a7c7-46fb-a0b8-2611511c69a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4295364-a7c7-46fb-a0b8-2611511c69a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe38b15-61c2-458f-bfee-a658c8d610a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe38b15-61c2-458f-bfee-a658c8d610a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26717ebe-e720-49c5-93b6-b79e75741277', 'volume_name': 'volume-26717ebe-e720-49c5-93b6-b79e75741277', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22c258-a5c1-41aa-8826-e6042fa7b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22c258-a5c1-41aa-8826-e6042fa7b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d26106-ebc2-4ab3-9827-92fd10ea39c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:05 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Volume 26717ebe-e720-49c5-93b6-b79e75741277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26717ebe-e720-49c5-93b6-b79e75741277', 'volume_size': 1} Apr 08 17:42:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:06 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.547s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:06 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info Apr 08 17:42:06 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:06 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:06 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info is being set with open permissions: ugo+rw Apr 08 17:42:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:06 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info Apr 08 17:42:06 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:07 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.info" returned: 0 in 0.511s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] snapshot: a10c8274-399b-40b1-8da2-f3391f03aae9, volume: e93acab3-2e83-4f6f-8bab-b581ab7081ff, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e886360-69c2-47ed-af1b-79bf594ca605]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:07 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:07 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:08 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.560s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31e822da-9815-4c0f-bf08-6524c82ccd3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[100ef823-230b-4cae-a496-c291a53c65e8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:08 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:08 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:08 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:42:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:08 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff Apr 08 17:42:08 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:11 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff" returned: 0 in 2.394s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba14e995-4cd8-4cbf-967b-2c9195e0a355]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:11 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:11 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:11 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.654s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:42:11 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Converted 1024.00 MB image at 427.53 MB/s Apr 08 17:42:11 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff is being set with open permissions: ugo+rw Apr 08 17:42:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:11 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff Apr 08 17:42:11 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:12 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" released by "_copy_volume_from_snapshot" :: held 4.617s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-a10c8274-399b-40b1-8da2-f3391f03aae9" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-a10c8274-399b-40b1-8da2-f3391f03aae9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Deleting offline snapshot a10c8274-399b-40b1-8da2-f3391f03aae9 of volume 31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] snapshot_file for this snap is: volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b1e936-2f9d-4441-8249-c6b6e073d7d7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:12 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:12 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:12 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.531s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31e822da-9815-4c0f-bf08-6524c82ccd3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[035758bc-910c-4e8c-abd6-e8964316d457]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:12 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:12 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:13 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:13 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:13 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:13 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.558s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:13 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9 Apr 08 17:42:13 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:14 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d.a10c8274-399b-40b1-8da2-f3391f03aae9" returned: 0 in 0.430s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-a10c8274-399b-40b1-8da2-f3391f03aae9" released by "_delete_snapshot" :: held 2.151s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.262s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.311s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642671644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26717ebe-e720-49c5-93b6-b79e75741277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:06Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Creating volume 26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:14 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c26e06-a923-45a2-ac57-82de8c175411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff', 'volume_size': 1, 'source_volid': '31e822da-9815-4c0f-bf08-6524c82ccd3d', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9688fc0a-b395-476f-8374-a5e9085450d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:14 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 1073741824 Apr 08 17:42:14 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Volume volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff (e93acab3-2e83-4f6f-8bab-b581ab7081ff): created successfully Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9688fc0a-b395-476f-8374-a5e9085450d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Flow 'volume_create_manager' (500e9f19-7f0a-4aa8-a6b5-68b6f5e3fd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-38225b94-e2e5-4d0d-892f-f65b60ea431e tempest-VolumeDependencyTests-682601165 None] Created volume successfully. Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-31e822da-9815-4c0f-bf08-6524c82ccd3d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-31e822da-9815-4c0f-bf08-6524c82ccd3d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-31e822da-9815-4c0f-bf08-6524c82ccd3d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-31e822da-9815-4c0f-bf08-6524c82ccd3d" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc9ee8-c3a7-4d52-989d-6d43858fc23e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:14 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:14 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:14 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 1073741824" returned: 0 in 0.526s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:14 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:14 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:15 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:15 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d Apr 08 17:42:15 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:15 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 0.416s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d26106-ebc2-4ab3-9827-92fd10ea39c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26717ebe-e720-49c5-93b6-b79e75741277', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaac2f69-6d4e-4f2a-8e53-fc91fdda17a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Volume volume-26717ebe-e720-49c5-93b6-b79e75741277 (26717ebe-e720-49c5-93b6-b79e75741277): created successfully Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaac2f69-6d4e-4f2a-8e53-fc91fdda17a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (da2f1bb0-81b7-4d3e-bcd0-1c478dd625ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:15 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8a6959dc-22bf-4abc-918c-187ad953dd05 tempest-VolumesSnapshotTestJSON-407727143 None] Created volume successfully. Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Creating offline snapshot c149662e-d0e0-465d-ab9b-595e75af480b of volume 26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[090afdac-d2ff-49d4-8b42-2c574e5eca5c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:15 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:15 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:15 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-31e822da-9815-4c0f-bf08-6524c82ccd3d" returned: 0 in 0.464s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-31e822da-9815-4c0f-bf08-6524c82ccd3d" released by "delete_volume" :: held 1.006s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Created reservations ['8161114b-1a22-4ad1-974e-f152f2ea432a', 'ce68d264-3ba9-4b97-b8ca-445ee9dce61c', '51530747-c5b6-4055-a450-521e841aa735', 'fe0b781e-e08a-4e84-9a92-61a0d075eaf7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:15 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:15 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:16 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:16 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b 1G Apr 08 17:42:16 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:16 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.476s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Deleted volume successfully. Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af4d9abd-a840-49c7-9352-21e8587f18e1 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-31e822da-9815-4c0f-bf08-6524c82ccd3d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:16 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b 1G" returned: 0 in 0.568s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26717ebe-e720-49c5-93b6-b79e75741277 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:16 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26717ebe-e720-49c5-93b6-b79e75741277 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:16 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-e93acab3-2e83-4f6f-8bab-b581ab7081ff-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "cinder-e93acab3-2e83-4f6f-8bab-b581ab7081ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" acquired by "delete_volume" :: waited 0.032s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8d901-3517-4dd8-8a60-a5aad8b2bf62]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:17 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff Apr 08 17:42:17 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:17 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26717ebe-e720-49c5-93b6-b79e75741277 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 0.791s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:17 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b is being set with open permissions: ugo+rw Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:17 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:17 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:17 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff" returned: 0 in 0.687s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:17 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff Apr 08 17:42:17 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:17 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 0.517s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:18 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info Apr 08 17:42:18 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:18 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e93acab3-2e83-4f6f-8bab-b581ab7081ff" returned: 0 in 0.622s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-e93acab3-2e83-4f6f-8bab-b581ab7081ff" released by "delete_volume" :: held 1.375s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Created reservations ['ae811fa6-61bc-45be-9936-a774158f0500', '5d65ef43-e267-44d9-ae72-10350b6c4b99', '8502c0bc-1b1c-4866-b39f-b0ad2be20266', 'e4471c25-b58b-4450-ab5a-1a6e5e357189'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:18 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:18 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:18 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info" returned: 0 in 0.720s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:18 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info is being set with open permissions: ugo+rw Apr 08 17:42:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:18 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info Apr 08 17:42:18 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-78383b78-39b2-4b89-bdc1-ca3c62745e59-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-78383b78-39b2-4b89-bdc1-ca3c62745e59-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44ec6a-9142-45ef-a4c4-1a486c0b43d2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:19 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.info" returned: 0 in 0.724s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.939s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8721cb06-461c-4abd-90c2-3cbb5f059588 tempest-VolumesSnapshotTestJSON-407727143 None] Create snapshot completed successfully Apr 08 17:42:19 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.910s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Deleted volume successfully. Apr 08 17:42:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2b7d4eb0-fa4a-49ea-bc58-5f160e04670f tempest-VolumeDependencyTests-682601165 None] Lock "cinder-e93acab3-2e83-4f6f-8bab-b581ab7081ff-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:19 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 Apr 08 17:42:19 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:20 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59" returned: 0 in 0.816s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:20 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59 Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:20 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (ec0918a0-80cb-4378-a13f-ca8fd4a8d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11df83f-f97b-4df8-ac84-6cf4d2acfe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11df83f-f97b-4df8-ac84-6cf4d2acfe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-886138921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89f24df-88f2-487f-aebf-553e18640d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c149662e-d0e0-465d-ab9b-595e75af480b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:20Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672dfa6a-0c33-4f3b-9128-f21d8dbe49da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672dfa6a-0c33-4f3b-9128-f21d8dbe49da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ab48c0-88ca-4693-b9f8-a6aea7d9aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ab48c0-88ca-4693-b9f8-a6aea7d9aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b89f24df-88f2-487f-aebf-553e18640d23', 'volume_name': 'volume-b89f24df-88f2-487f-aebf-553e18640d23', 'volume_size': 2, 'snapshot_id': 'c149662e-d0e0-465d-ab9b-595e75af480b'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf90a0-fc36-4e60-bbf0-df742ead66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccf90a0-fc36-4e60-bbf0-df742ead66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d53027-15f3-4ae1-98df-98956f313ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Volume b89f24df-88f2-487f-aebf-553e18640d23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b89f24df-88f2-487f-aebf-553e18640d23', 'volume_size': 2, 'snapshot_id': 'c149662e-d0e0-465d-ab9b-595e75af480b'} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b-b89f24df-88f2-487f-aebf-553e18640d23" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b-b89f24df-88f2-487f-aebf-553e18640d23" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Creating volume b89f24df-88f2-487f-aebf-553e18640d23 from snapshot c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] snapshot: c149662e-d0e0-465d-ab9b-595e75af480b, volume: b89f24df-88f2-487f-aebf-553e18640d23, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b3f34-8550-4ac7-9b71-f9010f8743f3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:20 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:20 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (3f15721f-c9be-4b85-ba02-36768fbddfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4d503c-212c-4202-b79e-c621179699c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4d503c-212c-4202-b79e-c621179699c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062733227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efebdfd-24d8-4fd8-9070-3c7e988ed7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:21Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a2781e-702f-4b9f-b91e-5bd068794270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a2781e-702f-4b9f-b91e-5bd068794270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11cc71-8f96-4dbe-b8bd-3fe86dbd6d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11cc71-8f96-4dbe-b8bd-3fe86dbd6d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efebdfd-24d8-4fd8-9070-3c7e988ed7bf', 'volume_name': 'volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d9e67-1d75-40ba-b1bb-4e10433b40a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d9e67-1d75-40ba-b1bb-4e10433b40a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff0ebe9-8c85-4ce1-86c0-ba15e7ef5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Volume 7efebdfd-24d8-4fd8-9070-3c7e988ed7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf', 'volume_size': 1} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:20 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-78383b78-39b2-4b89-bdc1-ca3c62745e59" returned: 0 in 0.724s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-quobyte-78383b78-39b2-4b89-bdc1-ca3c62745e59" released by "delete_volume" :: held 1.592s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Created reservations ['d38fc355-5aa1-423c-876d-5965fecff15b', '1adda2ef-83a5-405e-8243-6309080cf0de', '180b025f-ed5f-452e-8c4d-13aab04c5f99', '2e808bc0-3f2b-4bba-99c3-15eb1cc1dda8'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:21 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:21 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:21 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 0.727s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26717ebe-e720-49c5-93b6-b79e75741277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b591c0e-3446-4327-ac90-a4d50c56bb23]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:21 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:21 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:21 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.438s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:21 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Deleted volume successfully. Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8a3846a0-b9c6-406d-a421-e6f1a137d350 tempest-VolumeDependencyTests-682601165 None] Lock "cinder-78383b78-39b2-4b89-bdc1-ca3c62745e59-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:21 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 0.643s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:42:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:21 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 Apr 08 17:42:21 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:25 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23" returned: 0 in 3.684s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ca85f-a322-40f1-9c14-e52b786f2fb9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:25 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:25 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:26 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 1.230s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:26 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277, size 1024.00 MB, duration 3.68 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:42:26 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Converted 1024.00 MB image at 277.90 MB/s Apr 08 17:42:26 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 is being set with open permissions: ugo+rw Apr 08 17:42:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:26 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 Apr 08 17:42:26 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:27 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23" returned: 0 in 0.626s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" released by "_copy_volume_from_snapshot" :: held 6.983s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b-b89f24df-88f2-487f-aebf-553e18640d23" released by "_create_volume_from_snapshot" :: held 7.008s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.019s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.577s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1062733227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efebdfd-24d8-4fd8-9070-3c7e988ed7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:21Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Creating volume 7efebdfd-24d8-4fd8-9070-3c7e988ed7bf {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:27 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=126,cinder:INSERT=35,cinder:UPDATE=161,cinder:DELETE=15 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:42:27 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf 1073741824 Apr 08 17:42:27 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d53027-15f3-4ae1-98df-98956f313ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89f24df-88f2-487f-aebf-553e18640d23', 'volume_size': 2, 'snapshot_id': 'c149662e-d0e0-465d-ab9b-595e75af480b'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27226766-5182-42a0-8518-281975cf004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:27 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Volume volume-b89f24df-88f2-487f-aebf-553e18640d23 (b89f24df-88f2-487f-aebf-553e18640d23): created successfully Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27226766-5182-42a0-8518-281975cf004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:27 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (ec0918a0-80cb-4378-a13f-ca8fd4a8d08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:27 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f00f8811-55fd-4455-aa3e-5530b43d594b tempest-VolumesSnapshotTestJSON-407727143 None] Created volume successfully. Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-b89f24df-88f2-487f-aebf-553e18640d23-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-b89f24df-88f2-487f-aebf-553e18640d23-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a9d5f-ddea-4187-8065-1b29541317a0]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:28 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 Apr 08 17:42:28 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:28 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf 1073741824" returned: 0 in 1.208s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:28 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf Apr 08 17:42:28 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:29 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23" returned: 0 in 0.854s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:29 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23 Apr 08 17:42:29 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:29 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" returned: 0 in 0.806s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff0ebe9-8c85-4ce1-86c0-ba15e7ef5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f7a6f5-1a94-4bde-a586-16cdf7d846d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:INSERT=53,cinder:UPDATE=146,cinder:SELECT=127,cinder:DELETE=12 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:42:29 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Volume volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf (7efebdfd-24d8-4fd8-9070-3c7e988ed7bf): created successfully Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f7a6f5-1a94-4bde-a586-16cdf7d846d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (3f15721f-c9be-4b85-ba02-36768fbddfc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-82846cb8-e127-4f91-93cb-3747d257bbcc tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9bdd0e7a-2261-48ec-ba31-0b05f7d69399 tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" by "attach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9bdd0e7a-2261-48ec-ba31-0b05f7d69399 tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" acquired by "attach_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9bdd0e7a-2261-48ec-ba31-0b05f7d69399 tempest-VolumesActionsTest-76088106 None] Attaching volume 7efebdfd-24d8-4fd8-9070-3c7e988ed7bf to instance 450f7847-07aa-4be1-a2a5-a61e7c86080d at mountpoint /dev/vdb on host None. Apr 08 17:42:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9bdd0e7a-2261-48ec-ba31-0b05f7d69399 tempest-VolumesActionsTest-76088106 None] Attach volume completed successfully. Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9bdd0e7a-2261-48ec-ba31-0b05f7d69399 tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" released by "attach_volume" :: held 0.139s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:29 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b89f24df-88f2-487f-aebf-553e18640d23" returned: 0 in 0.768s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-b89f24df-88f2-487f-aebf-553e18640d23" released by "delete_volume" :: held 1.645s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['61df536a-087c-49ce-a7b0-eb5bbbe2dec1', '0f103f51-a580-4f26-acce-fa707d1c76b2', '0ed267b3-a580-454e-ad3c-fc3bf3c93f2e', 'ba6a95a9-1c8d-4ece-a659-cbd996ddf272'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:30 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:30 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-c149662e-d0e0-465d-ab9b-595e75af480b-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-c149662e-d0e0-465d-ab9b-595e75af480b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Deleting offline snapshot c149662e-d0e0-465d-ab9b-595e75af480b of volume 26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] snapshot_file for this snap is: volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[55561aa1-0f29-4cee-a068-bcff17c39d1f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:30 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:30 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:30 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.964s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:30 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Deleted volume successfully. Apr 08 17:42:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5fa48983-162a-4b52-bfed-f2377f0f0ee3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-b89f24df-88f2-487f-aebf-553e18640d23-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Terminate volume connection completed successfully. Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" by "detach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Detaching volume 7efebdfd-24d8-4fd8-9070-3c7e988ed7bf from instance 450f7847-07aa-4be1-a2a5-a61e7c86080d. Apr 08 17:42:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Detach volume completed successfully. Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd0fc2cf-9f71-4a87-b24b-838c2af691a3 tempest-VolumesActionsTest-741985692 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:31 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 1.186s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26717ebe-e720-49c5-93b6-b79e75741277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2276c-4dbb-4825-835e-7aeb8d77979c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:31 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:31 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8254a1c-734a-408d-9c1b-14ed446e57ba tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" by "detach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8254a1c-734a-408d-9c1b-14ed446e57ba tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:32 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f8254a1c-734a-408d-9c1b-14ed446e57ba tempest-VolumesActionsTest-76088106 None] Volume detach called, but volume not attached. Apr 08 17:42:32 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 0.682s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f8254a1c-734a-408d-9c1b-14ed446e57ba tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:32 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:32 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:33 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 0.762s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:33 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b Apr 08 17:42:33 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-quobyte-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "cinder-quobyte-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" acquired by "delete_volume" :: waited 0.035s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd32657-d187-4771-9be0-b21ed9ab60e8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:33 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf Apr 08 17:42:33 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:34 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277.c149662e-d0e0-465d-ab9b-595e75af480b" returned: 0 in 1.229s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-c149662e-d0e0-465d-ab9b-595e75af480b" released by "_delete_snapshot" :: held 3.955s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" released by "delete_snapshot" :: held 3.991s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:34 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['752dcba3-72fb-4395-83e3-df476e0c54a9', 'ee9be782-92a5-49da-9c4f-0d913a7eff5c', 'd947812a-1cf8-4838-98c3-63e5f736760e', '469a6bef-9aa7-4a9c-9b9d-f7c31104de3e'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" returned: 0 in 1.261s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:34 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf Apr 08 17:42:34 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Delete snapshot completed successfully. Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-df2c8628-a6ba-4f88-a8d9-cc5e50c3f7cc tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-c149662e-d0e0-465d-ab9b-595e75af480b-delete_snapshot" released by "delete_snapshot" :: held 4.358s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-26717ebe-e720-49c5-93b6-b79e75741277-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-26717ebe-e720-49c5-93b6-b79e75741277-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" acquired by "delete_volume" :: waited 0.037s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef217b-f8cd-4f7e-9ed4-31c6a54cd19f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:35 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:35 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:35 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" returned: 0 in 0.972s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "cinder-quobyte-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf" released by "delete_volume" :: held 2.303s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Created reservations ['86493ad0-6d61-4dda-83d6-5fa8a7791081', '1c9d7c9d-cb99-4518-9163-561fc1afec7b', '1791550e-fe38-4360-973e-893c09b8e421', '053476cc-bace-4fc5-b9dc-5e2c15afa9af'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:35 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:35 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:36 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 0.994s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:36 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277 Apr 08 17:42:36 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:37 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.231s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:37 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Deleted volume successfully. Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7b787d1f-9977-44b5-908d-c57d8409166e tempest-VolumesActionsTest-76088106 None] Lock "cinder-7efebdfd-24d8-4fd8-9070-3c7e988ed7bf-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:37 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26717ebe-e720-49c5-93b6-b79e75741277" returned: 0 in 1.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-26717ebe-e720-49c5-93b6-b79e75741277" released by "delete_volume" :: held 2.593s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['0c1c94c1-8580-47c2-8378-a8fd447d5d14', '135edd2c-d627-44ef-8afb-d66ab16f9935', '402f873f-5316-45e6-811f-d0b2732476c3', '9d96598f-4de2-4f80-a922-0033b1757a32'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:38 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:38 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:38 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.590s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:38 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:38 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Deleted volume successfully. Apr 08 17:42:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a8a64651-75a3-43ab-ac70-84632d8a87be tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-26717ebe-e720-49c5-93b6-b79e75741277-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (98d08c02-ae52-4a60-a4bd-02b65b20677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29627fc5-d726-42b0-a2cd-7b8248fe5c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29627fc5-d726-42b0-a2cd-7b8248fe5c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2026531550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1090a5-2971-429c-b89e-881cf46f9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:39Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64415f16-fc92-4792-bdeb-5dcb7363ac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64415f16-fc92-4792-bdeb-5dcb7363ac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898c4424-755f-4287-8102-f6bedbc8e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898c4424-755f-4287-8102-f6bedbc8e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1090a5-2971-429c-b89e-881cf46f9a0b', 'volume_name': 'volume-1c1090a5-2971-429c-b89e-881cf46f9a0b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc8139c-167d-4cd7-a7e3-ed793e0d71cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc8139c-167d-4cd7-a7e3-ed793e0d71cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39731c7-e2f7-4270-b13a-32894baa6881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:39 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Volume 1c1090a5-2971-429c-b89e-881cf46f9a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1090a5-2971-429c-b89e-881cf46f9a0b', 'volume_size': 1} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2026531550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1090a5-2971-429c-b89e-881cf46f9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:39Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Creating volume 1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:39 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:39 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b 1073741824 Apr 08 17:42:39 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:40 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b 1073741824" returned: 0 in 0.843s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:40 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:40 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:40 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39731c7-e2f7-4270-b13a-32894baa6881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1090a5-2971-429c-b89e-881cf46f9a0b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf26f9a-a8fd-4b6f-a155-54bdbbc635e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:40 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Volume volume-1c1090a5-2971-429c-b89e-881cf46f9a0b (1c1090a5-2971-429c-b89e-881cf46f9a0b): created successfully Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf26f9a-a8fd-4b6f-a155-54bdbbc635e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:40 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (98d08c02-ae52-4a60-a4bd-02b65b20677f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b3e32786-d2e3-4100-a461-f0fd08fffa95 tempest-VolumesSnapshotTestJSON-407727143 None] Created volume successfully. Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Creating offline snapshot 49714d28-f1d8-4c98-96b0-10f72316c1d3 of volume 1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab0b9e-ebd9-4d8b-abc9-25e20a4c8d82]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:41 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:41 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:41 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.599s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:41 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 1G Apr 08 17:42:41 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:42 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 1G" returned: 0 in 0.614s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1090a5-2971-429c-b89e-881cf46f9a0b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:42 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1090a5-2971-429c-b89e-881cf46f9a0b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:42 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:42 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c1090a5-2971-429c-b89e-881cf46f9a0b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:42 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 is being set with open permissions: ugo+rw Apr 08 17:42:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:42 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:42 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:43 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.557s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:43 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info Apr 08 17:42:43 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Flow 'volume_create_manager' (97fe2287-519a-4bea-8a58-7639d5bcdf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b263db-c1ff-41ea-a672-d053293b3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b263db-c1ff-41ea-a672-d053293b3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-825808024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26318ac9-84a1-46d0-96c8-e4b780298810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de3b4ef2a9c45f3928cde413dd5fe7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:44Z,use_quota=True,user_id='4dc9b133a22649829b639935dc0fde97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38249f0-aa70-4b02-9e0a-e38ea7eda7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38249f0-aa70-4b02-9e0a-e38ea7eda7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d6fe30-5429-48c1-9158-d63dc7a33826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d6fe30-5429-48c1-9158-d63dc7a33826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26318ac9-84a1-46d0-96c8-e4b780298810', 'volume_name': 'volume-26318ac9-84a1-46d0-96c8-e4b780298810', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fc49ce-1e88-4168-b247-875b1079c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fc49ce-1e88-4168-b247-875b1079c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e55ed-82a2-499f-930d-e512f1745dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Volume 26318ac9-84a1-46d0-96c8-e4b780298810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26318ac9-84a1-46d0-96c8-e4b780298810', 'volume_size': 1} Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:44 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info" returned: 0 in 0.815s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:44 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info is being set with open permissions: ugo+rw Apr 08 17:42:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:44 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info Apr 08 17:42:44 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:45 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.info" returned: 0 in 0.816s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.938s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-825808024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26318ac9-84a1-46d0-96c8-e4b780298810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de3b4ef2a9c45f3928cde413dd5fe7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:44Z,use_quota=True,user_id='4dc9b133a22649829b639935dc0fde97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Creating volume 26318ac9-84a1-46d0-96c8-e4b780298810 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:45 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (e19346b2-a6c0-4c51-9c20-b9beb0cf866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:45 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 1073741824 Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b473890-ad78-4fd6-8889-a73446bc7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:45 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4d432dc2-c27a-486e-8b56-598f3227e82b tempest-VolumesSnapshotTestJSON-407727143 None] Create snapshot completed successfully Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b473890-ad78-4fd6-8889-a73446bc7519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994862494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37d68b2-24af-40ae-b60f-5b11a3f611a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:45Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30a77e6-9d85-458a-8e4c-cbe7337f9ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30a77e6-9d85-458a-8e4c-cbe7337f9ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb79fdb-5c73-46db-8398-ff1c7cf7254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb79fdb-5c73-46db-8398-ff1c7cf7254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37d68b2-24af-40ae-b60f-5b11a3f611a5', 'volume_name': 'volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a8988-32f0-40b0-a019-5a421011b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1a8988-32f0-40b0-a019-5a421011b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9967432-da88-4058-b79e-dec6e82af7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:45 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Volume e37d68b2-24af-40ae-b60f-5b11a3f611a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5', 'volume_size': 1} Apr 08 17:42:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:46 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 1073741824" returned: 0 in 0.795s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:46 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 Apr 08 17:42:46 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (7a8aa105-1354-4616-bfa9-c99968bfbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278e9a2c-5dd4-4653-9496-7533ebac4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278e9a2c-5dd4-4653-9496-7533ebac4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-515227433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbd2aec-1cb2-4c10-b033-8caab6c8c68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abee34b4a124dd0a36ab81a4c3c2e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=49714d28-f1d8-4c98-96b0-10f72316c1d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:46Z,use_quota=True,user_id='d2c6a4d90cab4e1ea80c35d6f3c26e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6a57ec-d1c1-43ff-9800-685bd1d51f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6a57ec-d1c1-43ff-9800-685bd1d51f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19dba69-b5ae-4e0c-8f22-85d676f9fa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19dba69-b5ae-4e0c-8f22-85d676f9fa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adbd2aec-1cb2-4c10-b033-8caab6c8c68c', 'volume_name': 'volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c', 'volume_size': 1, 'snapshot_id': '49714d28-f1d8-4c98-96b0-10f72316c1d3'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8954038-f7ed-4ac6-90f1-b6c636fa9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8954038-f7ed-4ac6-90f1-b6c636fa9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e413dfa5-7d7e-42c2-93d6-a53190b13eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Volume adbd2aec-1cb2-4c10-b033-8caab6c8c68c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c', 'volume_size': 1, 'snapshot_id': '49714d28-f1d8-4c98-96b0-10f72316c1d3'} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:46 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810" returned: 0 in 0.805s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-994862494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37d68b2-24af-40ae-b60f-5b11a3f611a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:45Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Creating volume e37d68b2-24af-40ae-b60f-5b11a3f611a5 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:46 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e55ed-82a2-499f-930d-e512f1745dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26318ac9-84a1-46d0-96c8-e4b780298810', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff841d6-88e0-4399-b279-c0b4aa12ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:46 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 1073741824 Apr 08 17:42:46 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:46 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Volume volume-26318ac9-84a1-46d0-96c8-e4b780298810 (26318ac9-84a1-46d0-96c8-e4b780298810): created successfully Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff841d6-88e0-4399-b279-c0b4aa12ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Flow 'volume_create_manager' (97fe2287-519a-4bea-8a58-7639d5bcdf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b5b23118-64ed-4eb3-a26e-fd5eeddbd265 tempest-ServersNegativeTestJSON-1887574724 None] Created volume successfully. Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Flow 'volume_create_manager' (18bc1854-62f9-4e3d-adb1-625fffa519cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd6e2ee-a434-4c83-8e8c-959ab8405be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd6e2ee-a434-4c83-8e8c-959ab8405be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504675671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989621e7-4d9a-45bb-9368-09a9276759cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d4327654cb4d54ba5b9953ebc84c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:47Z,use_quota=True,user_id='33988abbc1584d56ab9981a7168417b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b9aacc-796c-42a1-aae2-2d24eb22fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b9aacc-796c-42a1-aae2-2d24eb22fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0a71bb-8eaf-4d11-89be-d7c748c63052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0a71bb-8eaf-4d11-89be-d7c748c63052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989621e7-4d9a-45bb-9368-09a9276759cf', 'volume_name': 'volume-989621e7-4d9a-45bb-9368-09a9276759cf', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed90b9c-db77-4676-9af0-e29cd441f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed90b9c-db77-4676-9af0-e29cd441f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5508b5af-7fd1-49c0-9223-6c5609d2070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:47 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Volume 989621e7-4d9a-45bb-9368-09a9276759cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989621e7-4d9a-45bb-9368-09a9276759cf', 'volume_size': 1} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:47 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 1073741824" returned: 0 in 0.719s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:47 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 Apr 08 17:42:47 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:48 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.768s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Creating volume adbd2aec-1cb2-4c10-b033-8caab6c8c68c from snapshot 49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9967432-da88-4058-b79e-dec6e82af7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34df9d8-21c1-4942-ae79-e88f9e857944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Volume volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 (e37d68b2-24af-40ae-b60f-5b11a3f611a5): created successfully Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34df9d8-21c1-4942-ae79-e88f9e857944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (e19346b2-a6c0-4c51-9c20-b9beb0cf866e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] snapshot: 49714d28-f1d8-4c98-96b0-10f72316c1d3, volume: adbd2aec-1cb2-4c10-b033-8caab6c8c68c, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:42:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6fb05f6b-fbed-4ee6-bc49-ee1646237c03 tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e0b9c-fd06-46fc-a45c-ad264e55a9d3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:48 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:48 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Flow 'volume_create_manager' (9989a5c6-ce61-46eb-aa66-f80e03946d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd076b58-69b0-4c07-bbaf-147c6222f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd076b58-69b0-4c07-bbaf-147c6222f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-732194524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff5d5ed-8494-47a1-a1ba-6262d56388d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de3b4ef2a9c45f3928cde413dd5fe7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:48Z,use_quota=True,user_id='4dc9b133a22649829b639935dc0fde97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b520a26-7972-4f08-b520-c4baaf8c9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b520a26-7972-4f08-b520-c4baaf8c9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e81d8-3586-4e38-b036-8cb53c8ce97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e81d8-3586-4e38-b036-8cb53c8ce97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff5d5ed-8494-47a1-a1ba-6262d56388d7', 'volume_name': 'volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5776db1-b37a-4fd3-ba2f-7d9b4c09baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5776db1-b37a-4fd3-ba2f-7d9b4c09baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70ccee2-22e5-4b6e-a2c2-b8ecf10d5249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:48 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Volume 3ff5d5ed-8494-47a1-a1ba-6262d56388d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7', 'volume_size': 1} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-e37d68b2-24af-40ae-b60f-5b11a3f611a5-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "cinder-e37d68b2-24af-40ae-b60f-5b11a3f611a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-quobyte-e37d68b2-24af-40ae-b60f-5b11a3f611a5" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-e37d68b2-24af-40ae-b60f-5b11a3f611a5" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e7afb-849b-44b5-a654-a63abd0216ad]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:48 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 Apr 08 17:42:48 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:48 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.532s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c1090a5-2971-429c-b89e-881cf46f9a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebfdd62-dd43-4cd9-b662-26705a10e6cc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:48 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:48 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:49 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5" returned: 0 in 0.488s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:49 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5 Apr 08 17:42:49 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:49 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:49 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c Apr 08 17:42:49 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:49 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37d68b2-24af-40ae-b60f-5b11a3f611a5" returned: 0 in 0.438s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-e37d68b2-24af-40ae-b60f-5b11a3f611a5" released by "delete_volume" :: held 0.945s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Created reservations ['006bd569-1bc0-4b95-b5bb-08c9701d3b30', '4cea1ccb-02ff-4239-b78e-e3313d5b3d2b', 'a8feb001-0a6d-4f4f-b7a9-f52829c14008', 'de92d59a-0efa-4f8d-8322-14d9fa2324eb'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:49 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:49 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:50 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:50 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (3acee604-2d1a-4654-a9c0-dbc5f3aa0a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8219e-5290-49c0-8308-a23d3b15a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8219e-5290-49c0-8308-a23d3b15a654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-345612401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a104729-d1cc-4017-97dc-6ee0a58d0d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:51Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94473d39-1c48-45ee-9d0c-29b3932f05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94473d39-1c48-45ee-9d0c-29b3932f05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ece14ec-734e-4e0c-b8bf-64cf34637f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ece14ec-734e-4e0c-b8bf-64cf34637f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a104729-d1cc-4017-97dc-6ee0a58d0d7d', 'volume_name': 'volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4522fce2-15c8-456d-834e-fb32660993fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4522fce2-15c8-456d-834e-fb32660993fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34eb8c59-5fff-467d-a814-f5adbbb855d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:51 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Volume 8a104729-d1cc-4017-97dc-6ee0a58d0d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d', 'volume_size': 1} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 1.390s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:51 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Deleted volume successfully. Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f243e4ba-0c3c-4f60-b47e-907f16fb742d tempest-VolumesActionsTest-741985692 None] Lock "cinder-e37d68b2-24af-40ae-b60f-5b11a3f611a5-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:51 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" returned: 0 in 2.444s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1785f-4eb7-4b76-b912-63ae375a4f6e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:51 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:51 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:52 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.612s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:42:52 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Converted 1024.00 MB image at 418.93 MB/s Apr 08 17:42:52 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c is being set with open permissions: ugo+rw Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:52 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c Apr 08 17:42:52 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:52 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" released by "_copy_volume_from_snapshot" :: held 4.595s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" released by "_create_volume_from_snapshot" :: held 4.642s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.657s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.450s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504675671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989621e7-4d9a-45bb-9368-09a9276759cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d4327654cb4d54ba5b9953ebc84c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:47Z,use_quota=True,user_id='33988abbc1584d56ab9981a7168417b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Creating volume 989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:52 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:52 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf 1073741824 Apr 08 17:42:52 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e413dfa5-7d7e-42c2-93d6-a53190b13eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c', 'volume_size': 1, 'snapshot_id': '49714d28-f1d8-4c98-96b0-10f72316c1d3'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58b898b-6758-41b6-85fe-05bd7ea2de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:52 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Volume volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c (adbd2aec-1cb2-4c10-b033-8caab6c8c68c): created successfully Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58b898b-6758-41b6-85fe-05bd7ea2de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Flow 'volume_create_manager' (7a8aa105-1354-4616-bfa9-c99968bfbb91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:52 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c0d4037b-3e94-4ffe-9f31-83e613d4dc08 tempest-VolumesSnapshotTestJSON-407727143 None] Created volume successfully. Apr 08 17:42:53 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf 1073741824" returned: 0 in 0.498s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:53 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:42:53 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:53 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.181s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-732194524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff5d5ed-8494-47a1-a1ba-6262d56388d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de3b4ef2a9c45f3928cde413dd5fe7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:48Z,use_quota=True,user_id='4dc9b133a22649829b639935dc0fde97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Creating volume 3ff5d5ed-8494-47a1-a1ba-6262d56388d7 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:53 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5508b5af-7fd1-49c0-9223-6c5609d2070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989621e7-4d9a-45bb-9368-09a9276759cf', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:53 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 1073741824 Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de04964d-3ef9-45e4-87b4-8d498a2c8062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:53 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:53 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Volume volume-989621e7-4d9a-45bb-9368-09a9276759cf (989621e7-4d9a-45bb-9368-09a9276759cf): created successfully Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de04964d-3ef9-45e4-87b4-8d498a2c8062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Flow 'volume_create_manager' (18bc1854-62f9-4e3d-adb1-625fffa519cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d401a195-a14f-4d3c-ab50-7cad3f284547 tempest-SnapshotDependencyTests-1486347692 None] Created volume successfully. Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-adbd2aec-1cb2-4c10-b033-8caab6c8c68c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-adbd2aec-1cb2-4c10-b033-8caab6c8c68c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[49582a87-d3c3-42d0-8756-06aff5d7110b]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:53 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c Apr 08 17:42:53 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:54 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 1073741824" returned: 0 in 0.537s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:54 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 Apr 08 17:42:54 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:54 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:54 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c Apr 08 17:42:54 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:54 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.651s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-345612401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a104729-d1cc-4017-97dc-6ee0a58d0d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:51Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Creating volume 8a104729-d1cc-4017-97dc-6ee0a58d0d7d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:54 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70ccee2-22e5-4b6e-a2c2-b8ecf10d5249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:54 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d 1073741824 Apr 08 17:42:54 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835a591-8f53-4473-8ff6-49f59cf03ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:54 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Volume volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 (3ff5d5ed-8494-47a1-a1ba-6262d56388d7): created successfully Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835a591-8f53-4473-8ff6-49f59cf03ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Flow 'volume_create_manager' (9989a5c6-ce61-46eb-aa66-f80e03946d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:54 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0bd3582b-aeda-438b-af1e-ff21751dffa9 tempest-ServersNegativeTestJSON-1887574724 None] Created volume successfully. Apr 08 17:42:54 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-adbd2aec-1cb2-4c10-b033-8caab6c8c68c" released by "delete_volume" :: held 0.979s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['bc609b01-5eda-4489-bc3a-6e8b688835f0', 'af3c6fdb-4621-469c-93dd-0099ee5da7b8', '3fb72c8f-b5f9-46cf-869a-2f92a55b692c', 'bec76b69-81dc-46e2-84d1-2efc3fd6ab67'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:54 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:54 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:55 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d 1073741824" returned: 0 in 0.533s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:55 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d Apr 08 17:42:55 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "cinder-3ff5d5ed-8494-47a1-a1ba-6262d56388d7-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-3ff5d5ed-8494-47a1-a1ba-6262d56388d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "cinder-quobyte-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-quobyte-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[036d1170-6111-4d1b-8037-3df2d0841483]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:55 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Deleted volume successfully. Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fb276a64-794b-41e5-9405-6bbe4c5e0077 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-adbd2aec-1cb2-4c10-b033-8caab6c8c68c-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:55 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 Apr 08 17:42:55 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:55 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" returned: 0 in 0.432s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.456s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Creating offline snapshot 90fee105-15f6-4991-9467-315ec186051c of volume 989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34eb8c59-5fff-467d-a814-f5adbbb855d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d69f8-0440-4578-928d-185c87e4f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae45d573-6154-4545-97f1-926dcad25bfc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:55 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Volume volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d (8a104729-d1cc-4017-97dc-6ee0a58d0d7d): created successfully Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d69f8-0440-4578-928d-185c87e4f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (3acee604-2d1a-4654-a9c0-dbc5f3aa0a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a7671a50-bbc1-4ae7-b38f-1ff32e0a5b87 tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:42:55 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:42:55 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:55 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" returned: 0 in 0.472s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:55 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7 Apr 08 17:42:55 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-49714d28-f1d8-4c98-96b0-10f72316c1d3-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-49714d28-f1d8-4c98-96b0-10f72316c1d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Deleting offline snapshot 49714d28-f1d8-4c98-96b0-10f72316c1d3 of volume 1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] snapshot_file for this snap is: volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ef4d9-45b6-4839-bcad-752038fe2a9c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:56 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.530s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c 1G Apr 08 17:42:56 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" returned: 0 in 0.461s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-quobyte-3ff5d5ed-8494-47a1-a1ba-6262d56388d7" released by "delete_volume" :: held 0.955s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-8a104729-d1cc-4017-97dc-6ee0a58d0d7d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "cinder-8a104729-d1cc-4017-97dc-6ee0a58d0d7d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-quobyte-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Created reservations ['9d76c934-4cea-4c2d-9bac-48e049523042', '52e37128-21c3-4623-bcb4-4c406fce726d', '5f31290c-378d-4ebd-89fe-2be864748835', 'e004deea-a8b2-459f-8c6c-91ee97828887'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c345f-f9fe-49b3-a3ac-5f8118568c7c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:56 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d Apr 08 17:42:56 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.526s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c1090a5-2971-429c-b89e-881cf46f9a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc52a0-8ae8-471a-9159-629dcd9011af]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:56 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c 1G" returned: 0 in 0.530s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989621e7-4d9a-45bb-9368-09a9276759cf -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989621e7-4d9a-45bb-9368-09a9276759cf -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:42:56 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:56 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:56 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Deleted volume successfully. Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-22b0e728-fe4c-43d3-9365-c10215de5a2d tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-3ff5d5ed-8494-47a1-a1ba-6262d56388d7-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:56 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:56 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d Apr 08 17:42:56 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.505s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:57 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989621e7-4d9a-45bb-9368-09a9276759cf -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c is being set with open permissions: ugo+rw Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:42:57 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" returned: 0 in 0.434s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-8a104729-d1cc-4017-97dc-6ee0a58d0d7d" released by "delete_volume" :: held 0.964s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Created reservations ['b421562b-33c4-4eb7-9c99-fd73df62d3e1', 'a8fa98e5-04ac-485a-a5cb-b4115a1101cd', '08a53ab3-7239-40a4-8584-5d5e24fa0748', '3142af9b-2c60-4a2a-b485-712d654088d1'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:57 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "cinder-26318ac9-84a1-46d0-96c8-e4b780298810-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-26318ac9-84a1-46d0-96c8-e4b780298810-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "cinder-quobyte-26318ac9-84a1-46d0-96c8-e4b780298810" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-quobyte-26318ac9-84a1-46d0-96c8-e4b780298810" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4077e384-7a10-4f4e-9979-d7ad93b72fcf]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.527s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3 Apr 08 17:42:57 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 Apr 08 17:42:57 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.468s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:57 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info Apr 08 17:42:57 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:57 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.461s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Deleted volume successfully. Apr 08 17:42:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-1b416a71-2e55-45dd-8e5f-a9276932268a tempest-VolumesActionsTest-741985692 None] Lock "cinder-8a104729-d1cc-4017-97dc-6ee0a58d0d7d-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:58 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b.49714d28-f1d8-4c98-96b0-10f72316c1d3" returned: 0 in 0.428s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:58 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-49714d28-f1d8-4c98-96b0-10f72316c1d3" released by "_delete_snapshot" :: held 2.039s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" released by "delete_snapshot" :: held 2.062s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:58 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810 Apr 08 17:42:58 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['c7df5439-5ed6-462e-a7d1-bf500409ab4f', 'bac83b08-309d-4a5c-9379-8b947c0515b9', '8916840e-9da8-4207-a429-6fcfff9a0ab2', 'afa8eab6-46fe-475e-b2ce-e4b0f44b4b81'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Delete snapshot completed successfully. Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea123480-104f-4264-ada2-54c9c2dd7377 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-49714d28-f1d8-4c98-96b0-10f72316c1d3-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:58 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info" returned: 0 in 0.428s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:58 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info is being set with open permissions: ugo+rw Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:58 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info Apr 08 17:42:58 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:58 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-26318ac9-84a1-46d0-96c8-e4b780298810" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-quobyte-26318ac9-84a1-46d0-96c8-e4b780298810" released by "delete_volume" :: held 0.959s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Created reservations ['95d9e256-2f54-4a6f-87ad-0c9d7c569e0f', '4730681a-5b2c-4383-bbb7-7e47d3604b38', '7c0f17dd-46f5-43cd-a5a5-4849bda41615', 'bdafa056-1a9f-4230-8e71-3dd0732cce21'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:58 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:42:58 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:58 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.info" returned: 0 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:58 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6950bc87-f908-4c19-aa2a-08b8384f5a5b tempest-SnapshotDependencyTests-1486347692 None] Create snapshot completed successfully Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (94efa1f3-710c-4e4f-815f-c4fbf942896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0d17fc-c581-4bde-ab27-77a711739ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0d17fc-c581-4bde-ab27-77a711739ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105485862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:59Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b4a3c2-1dab-4bdf-82f0-9205b967a09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b4a3c2-1dab-4bdf-82f0-9205b967a09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d14d33c-053d-4de3-8e13-6f6ab553757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d14d33c-053d-4de3-8e13-6f6ab553757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7', 'volume_name': 'volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ae98b1-19a6-4b05-9994-92777cb44b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ae98b1-19a6-4b05-9994-92777cb44b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e414080-01e7-402c-96b6-71456d77c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:58 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Volume 2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7', 'volume_size': 1} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105485862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:42:59Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Creating volume 2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:42:58 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:42:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:58 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 1073741824 Apr 08 17:42:58 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:59 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.593s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-1c1090a5-2971-429c-b89e-881cf46f9a0b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:59 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Deleted volume successfully. Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-1c1090a5-2971-429c-b89e-881cf46f9a0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-39195600-9b0e-486e-8449-6133a418823f tempest-ServersNegativeTestJSON-1887574724 None] Lock "cinder-26318ac9-84a1-46d0-96c8-e4b780298810-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8b8e7-162d-45bf-accb-c3709109077b]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:59 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:59 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:59 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 1073741824" returned: 0 in 0.645s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:59 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 Apr 08 17:42:59 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Flow 'volume_create_manager' (d0e26f0c-f46e-4886-9e79-2d6bc5ca6a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d67a26-c3c8-4e7d-94c8-3632efa4e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d67a26-c3c8-4e7d-94c8-3632efa4e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e90f35d-9aaf-4f2a-9d29-25203d588a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d4327654cb4d54ba5b9953ebc84c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90fee105-15f6-4991-9467-315ec186051c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:00Z,use_quota=True,user_id='33988abbc1584d56ab9981a7168417b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d572fd6-e67a-4711-99ee-db9e7a2e9411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d572fd6-e67a-4711-99ee-db9e7a2e9411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655f3848-ec76-429e-ba61-46b209bd1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:59 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (655f3848-ec76-429e-ba61-46b209bd1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e90f35d-9aaf-4f2a-9d29-25203d588a5c', 'volume_name': 'volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c', 'volume_size': 1, 'snapshot_id': '90fee105-15f6-4991-9467-315ec186051c'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc0acfe-d61b-4b3f-b4c9-7969880161f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc0acfe-d61b-4b3f-b4c9-7969880161f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9bd79a-f9fc-429e-8aef-97d8efbfd9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:42:59 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Volume 9e90f35d-9aaf-4f2a-9d29-25203d588a5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c', 'volume_size': 1, 'snapshot_id': '90fee105-15f6-4991-9467-315ec186051c'} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.718s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:42:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:42:59 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b Apr 08 17:42:59 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:00 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" returned: 0 in 0.568s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.168s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e414080-01e7-402c-96b6-71456d77c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4629189-9903-4e66-8b96-8a0c4793fcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Creating volume 9e90f35d-9aaf-4f2a-9d29-25203d588a5c from snapshot 90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:00 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Volume volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 (2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7): created successfully Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4629189-9903-4e66-8b96-8a0c4793fcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (94efa1f3-710c-4e4f-815f-c4fbf942896d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] snapshot: 90fee105-15f6-4991-9467-315ec186051c, volume: 9e90f35d-9aaf-4f2a-9d29-25203d588a5c, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:43:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a6087954-8065-4404-8b36-a2432dff4027 tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548c606-075a-4637-b4d7-5865ceac2842]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:00 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:43:00 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:00 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1c1090a5-2971-429c-b89e-881cf46f9a0b" returned: 0 in 0.441s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-1c1090a5-2971-429c-b89e-881cf46f9a0b" released by "delete_volume" :: held 1.198s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['3f9a324c-f768-42a4-b2e5-ec6d46bbd3b1', '04e34faf-4ecd-406b-90fc-750da9cb7a68', 'c3131860-0f37-457d-b507-3ec98bc9ec7f', 'fc722e5b-4821-42c7-a881-f5210b69fef7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:00 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:00 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:00 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989621e7-4d9a-45bb-9368-09a9276759cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0b1689-21c3-4802-9733-ab9879820075]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:00 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:43:00 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:00 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:00 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Deleted volume successfully. Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-38d1b7a6-f3be-4c65-8b72-2473acacfddb tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-1c1090a5-2971-429c-b89e-881cf46f9a0b-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "cinder-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-quobyte-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b38fb-ec51-4a34-b2fa-f0246b3e83e9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:01 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 Apr 08 17:43:01 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:01 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.559s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:01 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c Apr 08 17:43:01 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31705c-ef7d-4ae2-b019-34b3e56a1812]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:01 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 Apr 08 17:43:01 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:01 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" returned: 0 in 0.618s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:01 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7 Apr 08 17:43:01 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:02 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" returned: 0 in 1.319s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:02 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46 Apr 08 17:43:02 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:03 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:03 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:03 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" returned: 0 in 1.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7" released by "delete_volume" :: held 2.055s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Created reservations ['a1b26162-6935-4c8f-951c-02918c086887', '72d48fdd-d84a-40cd-aa82-3c584adba56d', '53500923-ad1f-4d42-a941-750ecf40e35f', 'a5568526-1c90-4bda-a8d0-0c6d3e3ed470'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:03 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:03 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:03 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" returned: 0 in 2.416s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e73c57-a03e-4589-bd67-0d0abc651e77]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:03 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.860s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:03 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:43:03 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:03 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" returned: 0 in 1.118s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-quobyte-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46" released by "delete_volume" :: held 2.470s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (03e63469-5c97-4cb4-9c3e-c95662decccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ef144c-9e2b-437f-b261-6710f792d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ef144c-9e2b-437f-b261-6710f792d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816248940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13d12d1-8092-4c92-8cdb-8c686282d985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:04Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3c748-c2c1-4bb6-a385-3f6e58048385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f3c748-c2c1-4bb6-a385-3f6e58048385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f626bddb-0f82-4c60-82ae-e0dd18a7d9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f626bddb-0f82-4c60-82ae-e0dd18a7d9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13d12d1-8092-4c92-8cdb-8c686282d985', 'volume_name': 'volume-a13d12d1-8092-4c92-8cdb-8c686282d985', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0764739a-766c-4fd4-b0f1-261ddcf2c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0764739a-766c-4fd4-b0f1-261ddcf2c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af178de3-8482-4e73-a290-c3b86d7e9576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Volume a13d12d1-8092-4c92-8cdb-8c686282d985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13d12d1-8092-4c92-8cdb-8c686282d985', 'volume_size': 1} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Created reservations ['bc3817da-c47f-4335-bcf9-5cd2be36d7c5', '43ecc562-3b86-4904-afc9-ecdf4d6c9ef5', '04e8bbff-b464-4e6e-91ea-046425bb1d5c', 'ea9ba75c-4b93-49da-8f16-6a2beacc2b01'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:04 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:04 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:04 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.810s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Deleted volume successfully. Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-303d63e8-9e58-41a7-af44-d492239a7a09 tempest-VolumesActionsTest-741985692 None] Lock "cinder-2fd5c1fb-0b93-46d2-abe9-9e4d83125bb7-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:04 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.723s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:43:04 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Converted 1024.00 MB image at 423.60 MB/s Apr 08 17:43:04 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c is being set with open permissions: ugo+rw Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:04 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c Apr 08 17:43:04 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:04 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Deleted volume successfully. Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-543c6672-0c04-46ef-9e23-661661035ed3 tempest-VolumesSnapshotTestJSON-407727143 None] Lock "cinder-7c39d4e2-7697-47bd-a1b2-a201c4f5bf46-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:04 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" returned: 0 in 0.441s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" released by "_copy_volume_from_snapshot" :: held 4.698s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" released by "_create_volume_from_snapshot" :: held 4.738s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.762s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816248940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13d12d1-8092-4c92-8cdb-8c686282d985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:04Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Creating volume a13d12d1-8092-4c92-8cdb-8c686282d985 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:04 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:04 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 1073741824 Apr 08 17:43:04 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9bd79a-f9fc-429e-8aef-97d8efbfd9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c', 'volume_size': 1, 'snapshot_id': '90fee105-15f6-4991-9467-315ec186051c'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb015583-024b-4dc2-bcfd-eec9c2f50d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:05 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Volume volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c (9e90f35d-9aaf-4f2a-9d29-25203d588a5c): created successfully Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb015583-024b-4dc2-bcfd-eec9c2f50d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Flow 'volume_create_manager' (d0e26f0c-f46e-4886-9e79-2d6bc5ca6a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7062f873-5013-4b43-9604-1d7a21a03426 tempest-SnapshotDependencyTests-1486347692 None] Created volume successfully. Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-90fee105-15f6-4991-9467-315ec186051c-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-90fee105-15f6-4991-9467-315ec186051c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Deleting offline snapshot 90fee105-15f6-4991-9467-315ec186051c of volume 989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] snapshot_file for this snap is: volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[da970e02-7df1-4943-a39c-452947c9c8ae]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:05 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:43:05 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:05 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 1073741824" returned: 0 in 0.606s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:05 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 Apr 08 17:43:05 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:06 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.604s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989621e7-4d9a-45bb-9368-09a9276759cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca461ad1-fcb4-4415-b1a6-3ea6d8729216]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:06 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af178de3-8482-4e73-a290-c3b86d7e9576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13d12d1-8092-4c92-8cdb-8c686282d985', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd32d9-ce92-4966-a3d3-c82bb3a04953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Volume volume-a13d12d1-8092-4c92-8cdb-8c686282d985 (a13d12d1-8092-4c92-8cdb-8c686282d985): created successfully Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fd32d9-ce92-4966-a3d3-c82bb3a04953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (03e63469-5c97-4cb4-9c3e-c95662decccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1589893c-afa9-4709-9dac-aeafbbac3e48 tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:43:06 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:43:06 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:06 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.550s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:06 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:43:06 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:07 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:07 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c Apr 08 17:43:07 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-a13d12d1-8092-4c92-8cdb-8c686282d985-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "cinder-a13d12d1-8092-4c92-8cdb-8c686282d985-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Acquiring lock "cinder-quobyte-a13d12d1-8092-4c92-8cdb-8c686282d985" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-a13d12d1-8092-4c92-8cdb-8c686282d985" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7220770e-c21c-406f-84d5-36a0d3b677fd]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:07 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 Apr 08 17:43:07 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:07 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf.90fee105-15f6-4991-9467-315ec186051c" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-90fee105-15f6-4991-9467-315ec186051c" released by "_delete_snapshot" :: held 2.318s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" released by "delete_snapshot" :: held 2.338s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Created reservations ['8899327f-89fe-47f6-98ee-a2df6faab842', '4963f014-952a-4ecf-a689-a58ce92810a5', 'c3014b02-07b3-4c04-ad1d-060e645284bd', '28ca19e8-7f63-4b34-b9e1-397aea2cbcc7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Delete snapshot completed successfully. Apr 08 17:43:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d7a85b7-5a1a-4ec8-a56e-53caa6265f8c tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-90fee105-15f6-4991-9467-315ec186051c-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:08 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985" returned: 0 in 0.659s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:08 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985 Apr 08 17:43:08 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-989621e7-4d9a-45bb-9368-09a9276759cf-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-989621e7-4d9a-45bb-9368-09a9276759cf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee158261-7669-4518-a972-e74c06ad4683]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:08 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a13d12d1-8092-4c92-8cdb-8c686282d985" returned: 0 in 0.567s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "cinder-quobyte-a13d12d1-8092-4c92-8cdb-8c686282d985" released by "delete_volume" :: held 1.270s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Created reservations ['fc498cf9-e8c9-4e89-a5ed-98007832b09d', 'bdb1dabf-709c-4ddd-8199-3408c248382e', '0d42f5cb-492f-461e-b723-5123f32cd81e', '78e2de72-3bee-4eac-97b3-21de110df824'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:08 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:43:08 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:08 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:08 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:09 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:09 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf Apr 08 17:43:09 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:09 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.505s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Deleted volume successfully. Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-381aa7fc-5ac5-49a7-94f6-699fdfd4a879 tempest-VolumesActionsTest-741985692 None] Lock "cinder-a13d12d1-8092-4c92-8cdb-8c686282d985-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:09 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-989621e7-4d9a-45bb-9368-09a9276759cf" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-989621e7-4d9a-45bb-9368-09a9276759cf" released by "delete_volume" :: held 1.080s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Created reservations ['e800884d-e8ed-44e5-8800-14ffb07eace9', '335693fc-b9c1-4f64-8d46-47b1d6fb1087', '510c0a5e-0d28-421d-852c-4afe9b9b6541', '95620802-ef36-4d66-9417-bd1fd9175417'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:09 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:09 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:09 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (94c1313d-7490-4240-858f-388e3b08e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659678ab-c534-4d07-9bde-35a52aeb5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659678ab-c534-4d07-9bde-35a52aeb5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953161978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b7278-21cb-45f8-86ad-89e425667b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55dcc1-1712-4fb2-a407-bdf31f0d2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55dcc1-1712-4fb2-a407-bdf31f0d2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3c736d-8afb-4182-a556-9282a9e1182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3c736d-8afb-4182-a556-9282a9e1182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0b7278-21cb-45f8-86ad-89e425667b2a', 'volume_name': 'volume-0e0b7278-21cb-45f8-86ad-89e425667b2a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a415d9-f09a-4fe2-b3cb-96a535d910b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a415d9-f09a-4fe2-b3cb-96a535d910b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa331d3-5d0e-4613-9f75-d8d028863062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume 0e0b7278-21cb-45f8-86ad-89e425667b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0b7278-21cb-45f8-86ad-89e425667b2a', 'volume_size': 1} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953161978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0b7278-21cb-45f8-86ad-89e425667b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume 0e0b7278-21cb-45f8-86ad-89e425667b2a {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:10 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-9e90f35d-9aaf-4f2a-9d29-25203d588a5c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:10 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a 1073741824 Apr 08 17:43:10 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (60c46e5f-058e-4a14-b3cb-47cd327a1ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba62909-2fdd-49b5-8f96-045959d82a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-9e90f35d-9aaf-4f2a-9d29-25203d588a5c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (02c84855-be5a-44fe-bf91-a3e3396770ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901db621-2e4f-4a9b-80ae-44a064e24ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba62909-2fdd-49b5-8f96-045959d82a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015526cb-0cbb-4a02-a1f6-7234da10183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e59387a-e678-4744-94b0-251400cbac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e59387a-e678-4744-94b0-251400cbac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2ba20-ec09-499a-a4f7-9741a70c779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2ba20-ec09-499a-a4f7-9741a70c779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015526cb-0cbb-4a02-a1f6-7234da10183d', 'volume_name': 'volume-015526cb-0cbb-4a02-a1f6-7234da10183d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d007755-f300-4a13-bc97-3f1c99d12370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d007755-f300-4a13-bc97-3f1c99d12370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf140cc-b65f-437b-8caa-5169a6dc3176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Volume 015526cb-0cbb-4a02-a1f6-7234da10183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015526cb-0cbb-4a02-a1f6-7234da10183d', 'volume_size': 1} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901db621-2e4f-4a9b-80ae-44a064e24ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-529326130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f6219-4dab-49c4-88bf-08dc677a087e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec2fd75-783a-4550-a01a-77908f7be68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec2fd75-783a-4550-a01a-77908f7be68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd115ec-73bd-4505-8bcb-bc8a27783464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd115ec-73bd-4505-8bcb-bc8a27783464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35f6219-4dab-49c4-88bf-08dc677a087e', 'volume_name': 'volume-f35f6219-4dab-49c4-88bf-08dc677a087e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126c950f-d778-4321-9f92-004482f17bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126c950f-d778-4321-9f92-004482f17bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606b918-c902-4019-8f65-617aac0e524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:10 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Volume f35f6219-4dab-49c4-88bf-08dc677a087e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35f6219-4dab-49c4-88bf-08dc677a087e', 'volume_size': 1} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c812966-491b-4fbc-a22a-6412032793bb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:10 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.564s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Deleted volume successfully. Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-eac74bc9-9e39-4788-85f3-cd8cfa3038fc tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-989621e7-4d9a-45bb-9368-09a9276759cf-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:10 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c Apr 08 17:43:10 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:10 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a 1073741824" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:10 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a Apr 08 17:43:10 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:10 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:10 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c Apr 08 17:43:10 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:11 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210282963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015526cb-0cbb-4a02-a1f6-7234da10183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7075eb11fd0d4747a620fe6aa3fbf411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='add8fc49dde8482ebdaee5c37da5bacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Creating volume 015526cb-0cbb-4a02-a1f6-7234da10183d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa331d3-5d0e-4613-9f75-d8d028863062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0b7278-21cb-45f8-86ad-89e425667b2a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d62f0b-ff8b-485a-9d09-71c10a584f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:11 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d 1073741824 Apr 08 17:43:11 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-0e0b7278-21cb-45f8-86ad-89e425667b2a (0e0b7278-21cb-45f8-86ad-89e425667b2a): created successfully Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d62f0b-ff8b-485a-9d09-71c10a584f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (94c1313d-7490-4240-858f-388e3b08e92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d0e75cb2-83ea-451d-a917-0b0500276909 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:11 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" returned: 0 in 0.465s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-quobyte-9e90f35d-9aaf-4f2a-9d29-25203d588a5c" released by "delete_volume" :: held 0.987s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Created reservations ['edb02f5d-53a5-4fc4-ac66-7419f337da6b', '95684544-c7e3-48e7-8218-453430abd7da', 'c16f1091-2467-4fa9-b0b1-8897de6624c6', '83487795-c80a-492d-8ce4-b8fed56dd38b'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:11 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:11 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:11 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d 1073741824" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:11 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d Apr 08 17:43:11 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:11 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.438s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Deleted volume successfully. Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-f663592a-c8d5-4617-8ffb-e796762da290 tempest-SnapshotDependencyTests-1486347692 None] Lock "cinder-9e90f35d-9aaf-4f2a-9d29-25203d588a5c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:11 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d" returned: 0 in 0.398s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-529326130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35f6219-4dab-49c4-88bf-08dc677a087e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:10Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Creating volume f35f6219-4dab-49c4-88bf-08dc677a087e {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf140cc-b65f-437b-8caa-5169a6dc3176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015526cb-0cbb-4a02-a1f6-7234da10183d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7484c-cf11-40d1-b086-8a0ea415fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:11 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e 1073741824 Apr 08 17:43:11 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Volume volume-015526cb-0cbb-4a02-a1f6-7234da10183d (015526cb-0cbb-4a02-a1f6-7234da10183d): created successfully Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac7484c-cf11-40d1-b086-8a0ea415fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Flow 'volume_create_manager' (60c46e5f-058e-4a14-b3cb-47cd327a1ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2f61a0f0-b393-4ab9-a87a-5328a95073bd tempest-VolumesActionsTest-76088106 None] Created volume successfully. Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (5b05d2da-a1c2-45ee-8578-73df83be8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc3c26c-9858-4491-8690-b1cb5c1de4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc3c26c-9858-4491-8690-b1cb5c1de4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859208574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be7cb42-5d9c-485a-ac3e-afece648206e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:12Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f46737-bbd7-464a-852a-7bd4787682d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f46737-bbd7-464a-852a-7bd4787682d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e121a8-1fd9-439d-ae2b-eeca07565ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e121a8-1fd9-439d-ae2b-eeca07565ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be7cb42-5d9c-485a-ac3e-afece648206e', 'volume_name': 'volume-7be7cb42-5d9c-485a-ac3e-afece648206e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea84c627-d51b-4670-9f91-a6d8a9dd947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea84c627-d51b-4670-9f91-a6d8a9dd947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e689d5-eaa5-4edd-9990-62da7ab071fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume 7be7cb42-5d9c-485a-ac3e-afece648206e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be7cb42-5d9c-485a-ac3e-afece648206e', 'volume_size': 1} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:12 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e 1073741824" returned: 0 in 0.687s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (08187478-5aeb-4ead-8279-f86ae574381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e59050e-cf4a-474a-81b5-65adfe110928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e59050e-cf4a-474a-81b5-65adfe110928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381933825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d51212-851f-4043-b8a6-ea9c7e4bbff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f1959f-781c-4e35-a71b-5ecd6af16664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f1959f-781c-4e35-a71b-5ecd6af16664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5cfc58-8b33-48b8-8c51-68694280ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5cfc58-8b33-48b8-8c51-68694280ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d51212-851f-4043-b8a6-ea9c7e4bbff0', 'volume_name': 'volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0d6e02-d8dd-44cd-a113-93dc9eb858ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0d6e02-d8dd-44cd-a113-93dc9eb858ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135d70c0-129c-4274-9512-701d7a4d7491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume b6d51212-851f-4043-b8a6-ea9c7e4bbff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0', 'volume_size': 1} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-015526cb-0cbb-4a02-a1f6-7234da10183d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:12 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e Apr 08 17:43:12 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "cinder-015526cb-0cbb-4a02-a1f6-7234da10183d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Acquiring lock "cinder-quobyte-015526cb-0cbb-4a02-a1f6-7234da10183d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "cinder-quobyte-015526cb-0cbb-4a02-a1f6-7234da10183d" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (2a14532a-a735-4a9c-b75e-35d8b2c8e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b7b67-d0a3-4f31-a44f-d4876e94212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e5e70f-e116-4cf0-a172-e1c5533fd2e8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b7b67-d0a3-4f31-a44f-d4876e94212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348177189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3383e3-5137-4f01-b23a-4b83b6fe93c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fdeb66-1186-4ab7-afcb-df54ef4475c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fdeb66-1186-4ab7-afcb-df54ef4475c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9d76e1-0613-436e-8f10-9088cff75fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9d76e1-0613-436e-8f10-9088cff75fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3383e3-5137-4f01-b23a-4b83b6fe93c4', 'volume_name': 'volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb679b9-eca8-4112-a5e4-80132b6668ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb679b9-eca8-4112-a5e4-80132b6668ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4430d19e-8660-4391-bd17-2161c54dd3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume ad3383e3-5137-4f01-b23a-4b83b6fe93c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4', 'volume_size': 1} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (adbb9e6a-e5d6-47ec-a627-10ddab4dfe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f06086-b3b0-45f3-9bfb-9077ee4a5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d Apr 08 17:43:13 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f06086-b3b0-45f3-9bfb-9077ee4a5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90796913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9ba21c-e035-4f4a-b220-da998d6aa98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63837e86-b119-4f96-b6c0-8200b283a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63837e86-b119-4f96-b6c0-8200b283a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfda782-5cd1-421c-868d-ee02d54b6cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfda782-5cd1-421c-868d-ee02d54b6cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9ba21c-e035-4f4a-b220-da998d6aa98c', 'volume_name': 'volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7f92d8-6d2f-426f-92cc-57365bf4d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7f92d8-6d2f-426f-92cc-57365bf4d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7bdd52-02db-4500-8912-7ac6b0dd0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume 1a9ba21c-e035-4f4a-b220-da998d6aa98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c', 'volume_size': 1} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:13 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e" returned: 0 in 0.548s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859208574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be7cb42-5d9c-485a-ac3e-afece648206e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:12Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume 7be7cb42-5d9c-485a-ac3e-afece648206e {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:13 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e 1073741824 Apr 08 17:43:13 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606b918-c902-4019-8f65-617aac0e524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35f6219-4dab-49c4-88bf-08dc677a087e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363e3582-9d86-4331-b4bf-3b8502bda545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (13b87d46-d123-461f-a3d3-4178b396cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3770d95c-1feb-4579-85b2-acd2e36734a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Volume volume-f35f6219-4dab-49c4-88bf-08dc677a087e (f35f6219-4dab-49c4-88bf-08dc677a087e): created successfully Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363e3582-9d86-4331-b4bf-3b8502bda545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (02c84855-be5a-44fe-bf91-a3e3396770ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3770d95c-1feb-4579-85b2-acd2e36734a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-437332182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02260402-74cf-427f-ad10-9bb99f47166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9019f3-ebe3-4dcc-a2ae-d975b0f120f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9019f3-ebe3-4dcc-a2ae-d975b0f120f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0133a69-594c-46be-87cb-110451361873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0133a69-594c-46be-87cb-110451361873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02260402-74cf-427f-ad10-9bb99f47166d', 'volume_name': 'volume-02260402-74cf-427f-ad10-9bb99f47166d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cad629c-3de0-40a5-b80d-007bda2e1923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cad629c-3de0-40a5-b80d-007bda2e1923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c1fe7-d027-4ab3-a263-c0004850ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume 02260402-74cf-427f-ad10-9bb99f47166d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02260402-74cf-427f-ad10-9bb99f47166d', 'volume_size': 1} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ff20be68-ec42-47b1-92e5-e845e4232891 tempest-VolumesTestJSON-1101027009 None] Created volume successfully. Apr 08 17:43:13 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d" returned: 0 in 0.764s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:13 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d Apr 08 17:43:13 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:13 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e 1073741824" returned: 0 in 0.558s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:13 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e Apr 08 17:43:13 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:14 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-015526cb-0cbb-4a02-a1f6-7234da10183d" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "cinder-quobyte-015526cb-0cbb-4a02-a1f6-7234da10183d" released by "delete_volume" :: held 1.251s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Created reservations ['90b191b2-0e50-4928-924e-d7a276283448', '0f375421-3ad7-4839-996a-f857c1577f32', 'b0a24c2b-a191-4e4a-88b2-caa6683e2404', '4a644925-d094-4ca0-989a-616b6fdc90b6'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:14 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:14 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:14 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1381933825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d51212-851f-4043-b8a6-ea9c7e4bbff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume b6d51212-851f-4043-b8a6-ea9c7e4bbff0 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:14 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e689d5-eaa5-4edd-9990-62da7ab071fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be7cb42-5d9c-485a-ac3e-afece648206e', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62988909-6dff-415b-a829-dc607e447d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 1073741824 Apr 08 17:43:14 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-7be7cb42-5d9c-485a-ac3e-afece648206e (7be7cb42-5d9c-485a-ac3e-afece648206e): created successfully Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62988909-6dff-415b-a829-dc607e447d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (5b05d2da-a1c2-45ee-8578-73df83be8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ca484d14-dad8-4747-aca5-d3778f63209d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (d8622341-9371-46f4-8d38-f0f0a9191530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4eb3ad9-9842-4735-9149-cd2aec25ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4eb3ad9-9842-4735-9149-cd2aec25ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364715307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb222469-ed5f-4f3a-8a09-379a861b875b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:15Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eee001-c08e-4915-a89a-f84090b08606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eee001-c08e-4915-a89a-f84090b08606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8092b25f-b4ad-43dd-a4bd-341f165867bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8092b25f-b4ad-43dd-a4bd-341f165867bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb222469-ed5f-4f3a-8a09-379a861b875b', 'volume_name': 'volume-bb222469-ed5f-4f3a-8a09-379a861b875b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df91251d-637b-479c-9de8-bd5bbaa1e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df91251d-637b-479c-9de8-bd5bbaa1e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301e7039-f146-4102-9fbb-79c72e2df6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:14 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Volume bb222469-ed5f-4f3a-8a09-379a861b875b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb222469-ed5f-4f3a-8a09-379a861b875b', 'volume_size': 1} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:14 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.651s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Deleted volume successfully. Apr 08 17:43:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8b47dbe9-689b-4850-8fe3-5448e1cda1ff tempest-VolumesActionsTest-76088106 None] Lock "cinder-015526cb-0cbb-4a02-a1f6-7234da10183d-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:15 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 1073741824" returned: 0 in 0.689s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:15 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 Apr 08 17:43:15 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:15 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.667s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348177189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3383e3-5137-4f01-b23a-4b83b6fe93c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume ad3383e3-5137-4f01-b23a-4b83b6fe93c4 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:15 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:15 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 1073741824 Apr 08 17:43:15 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135d70c0-129c-4274-9512-701d7a4d7491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510f12b8-9337-404b-ac4c-83249201fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 (b6d51212-851f-4043-b8a6-ea9c7e4bbff0): created successfully Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510f12b8-9337-404b-ac4c-83249201fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (08187478-5aeb-4ead-8279-f86ae574381e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:15 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6f89a822-23a6-442a-bfef-9384794d9b3f tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:16 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 1073741824" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:16 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 Apr 08 17:43:16 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:16 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" returned: 0 in 0.512s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90796913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9ba21c-e035-4f4a-b220-da998d6aa98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume 1a9ba21c-e035-4f4a-b220-da998d6aa98c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:16 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:16 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c 1073741824 Apr 08 17:43:16 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4430d19e-8660-4391-bd17-2161c54dd3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787d13f-439f-4716-9ca4-c9bc36b30984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:16 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 (ad3383e3-5137-4f01-b23a-4b83b6fe93c4): created successfully Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787d13f-439f-4716-9ca4-c9bc36b30984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (2a14532a-a735-4a9c-b75e-35d8b2c8e533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-020fc8c7-85b2-4170-b084-9d3efff629c0 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:17 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c 1073741824" returned: 0 in 0.645s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:17 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c Apr 08 17:43:17 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:17 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c" returned: 0 in 0.526s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.527s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-437332182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02260402-74cf-427f-ad10-9bb99f47166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da3d3a7cd5d4a62bf46c0dee177b062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:13Z,use_quota=True,user_id='504c4f5e7fad42cba1440a9aa8835ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Creating volume 02260402-74cf-427f-ad10-9bb99f47166d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:17 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7bdd52-02db-4500-8912-7ac6b0dd0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6206f-c258-4d9c-bd2f-3c317875b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:18 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d 1073741824 Apr 08 17:43:18 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:18 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c (1a9ba21c-e035-4f4a-b220-da998d6aa98c): created successfully Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6206f-c258-4d9c-bd2f-3c317875b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (adbb9e6a-e5d6-47ec-a627-10ddab4dfe3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6c830325-e0d5-4419-ad37-9c57e7d77bdd tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:18 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d 1073741824" returned: 0 in 0.574s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:18 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d Apr 08 17:43:18 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:19 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.318s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364715307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb222469-ed5f-4f3a-8a09-379a861b875b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:15Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Creating volume bb222469-ed5f-4f3a-8a09-379a861b875b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:19 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c1fe7-d027-4ab3-a263-c0004850ec93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02260402-74cf-427f-ad10-9bb99f47166d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc114a-f0e9-402a-b04c-70e35a378593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:19 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b 1073741824 Apr 08 17:43:19 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:19 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Volume volume-02260402-74cf-427f-ad10-9bb99f47166d (02260402-74cf-427f-ad10-9bb99f47166d): created successfully Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc114a-f0e9-402a-b04c-70e35a378593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Flow 'volume_create_manager' (13b87d46-d123-461f-a3d3-4178b396cec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f9f637f4-20e3-4238-9c89-3d9825142183 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created volume successfully. Apr 08 17:43:19 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b 1073741824" returned: 0 in 0.609s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:19 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b Apr 08 17:43:19 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-02260402-74cf-427f-ad10-9bb99f47166d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-02260402-74cf-427f-ad10-9bb99f47166d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-02260402-74cf-427f-ad10-9bb99f47166d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-02260402-74cf-427f-ad10-9bb99f47166d" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c110390-24e1-4751-943d-73d0930cc8bd]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:20 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d Apr 08 17:43:20 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:20 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b" returned: 0 in 0.454s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301e7039-f146-4102-9fbb-79c72e2df6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb222469-ed5f-4f3a-8a09-379a861b875b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848e62e6-3b24-4285-ae97-36a67fb283e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Volume volume-bb222469-ed5f-4f3a-8a09-379a861b875b (bb222469-ed5f-4f3a-8a09-379a861b875b): created successfully Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848e62e6-3b24-4285-ae97-36a67fb283e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (d8622341-9371-46f4-8d38-f0f0a9191530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8a40481d-b2af-4d3e-bd28-5e5b7ca4cfd8 tempest-VolumesTestJSON-1101027009 None] Created volume successfully. Apr 08 17:43:20 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d" returned: 0 in 0.547s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:20 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d Apr 08 17:43:20 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:21 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-02260402-74cf-427f-ad10-9bb99f47166d" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-02260402-74cf-427f-ad10-9bb99f47166d" released by "delete_volume" :: held 1.063s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['2a784542-c716-4f78-a27a-2b009ed62fe8', 'aa29e0c6-89de-4ab5-abc4-265dad3e7ec0', '1e61e576-73e8-4bd1-ae04-91a0cbb75339', 'bb20f175-c128-4cd5-acbd-220b9ee2dcd0'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:21 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:21 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (8e1b16ac-8b40-415d-bfcc-b4b003042f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9999447-363a-47b6-8984-c805271e440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9999447-363a-47b6-8984-c805271e440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2122707475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18187c-5f39-47a3-9e2a-c570d890aa64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:21Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9054dc-26dd-4fd9-96f3-5f391afebc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9054dc-26dd-4fd9-96f3-5f391afebc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1493192-acb1-4f5f-8e5d-db45fa5ad613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1493192-acb1-4f5f-8e5d-db45fa5ad613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff18187c-5f39-47a3-9e2a-c570d890aa64', 'volume_name': 'volume-ff18187c-5f39-47a3-9e2a-c570d890aa64', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa9514b-6545-49c7-99f9-19faf957a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa9514b-6545-49c7-99f9-19faf957a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01223b31-0292-4b7d-8c96-a38783dcc882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:21 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Volume ff18187c-5f39-47a3-9e2a-c570d890aa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff18187c-5f39-47a3-9e2a-c570d890aa64', 'volume_size': 1} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2122707475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18187c-5f39-47a3-9e2a-c570d890aa64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77d177e70168404e99ba3bf0c2d82166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:21Z,use_quota=True,user_id='e1dc35dc8375499bb3c425f9b3c6f1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Creating volume ff18187c-5f39-47a3-9e2a-c570d890aa64 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:21 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:21 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 1073741824 Apr 08 17:43:21 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:21 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.507s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:21 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-74c639e5-20de-4fbd-a68e-e339a268644c tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-02260402-74cf-427f-ad10-9bb99f47166d-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:21 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 1073741824" returned: 0 in 0.554s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:22 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 Apr 08 17:43:22 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-1a9ba21c-e035-4f4a-b220-da998d6aa98c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-1a9ba21c-e035-4f4a-b220-da998d6aa98c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-1a9ba21c-e035-4f4a-b220-da998d6aa98c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-1a9ba21c-e035-4f4a-b220-da998d6aa98c" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c716a48-2644-425c-b827-affa6ae5e254]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:22 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c Apr 08 17:43:22 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:22 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01223b31-0292-4b7d-8c96-a38783dcc882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff18187c-5f39-47a3-9e2a-c570d890aa64', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e01acb-3486-45f7-bdff-fa0a2ca82ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:22 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Volume volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 (ff18187c-5f39-47a3-9e2a-c570d890aa64): created successfully Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e01acb-3486-45f7-bdff-fa0a2ca82ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Flow 'volume_create_manager' (8e1b16ac-8b40-415d-bfcc-b4b003042f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0f124bad-117b-481a-8047-d739044ba30c tempest-VolumesTestJSON-1101027009 None] Created volume successfully. Apr 08 17:43:22 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c" returned: 0 in 0.545s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:22 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c Apr 08 17:43:22 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:23 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1a9ba21c-e035-4f4a-b220-da998d6aa98c" returned: 0 in 0.450s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-1a9ba21c-e035-4f4a-b220-da998d6aa98c" released by "delete_volume" :: held 1.025s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['ee588ec2-5c02-443d-8230-e72d7557976b', '9b8d6950-dbd2-43fe-a5b2-792367466bf3', '313d9237-875c-4f8a-812c-710e02f06d7e', 'ec5120bf-b574-4a21-9992-88d1007124fb'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:23 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:23 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:23 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.476s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:23 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-423c25f7-f463-4e6a-a394-dfb34e47732a tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-1a9ba21c-e035-4f4a-b220-da998d6aa98c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-ff18187c-5f39-47a3-9e2a-c570d890aa64-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "cinder-ff18187c-5f39-47a3-9e2a-c570d890aa64-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-quobyte-ff18187c-5f39-47a3-9e2a-c570d890aa64" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-ff18187c-5f39-47a3-9e2a-c570d890aa64" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb243c6c-8c3c-4a7f-bb94-3810031b1099]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:24 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 Apr 08 17:43:24 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-ad3383e3-5137-4f01-b23a-4b83b6fe93c4-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-ad3383e3-5137-4f01-b23a-4b83b6fe93c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceae4c3-e7a6-46d1-bd85-85a0c0b0df13]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:24 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 Apr 08 17:43:24 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:24 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64" returned: 0 in 0.571s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:24 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64 Apr 08 17:43:24 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Flow 'volume_create_manager' (5362a2d7-7865-49c7-a580-3162ffffb26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4086e5b1-2d60-4d6c-84c3-fcd6a1396c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4086e5b1-2d60-4d6c-84c3-fcd6a1396c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1675462924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480d212d-ef7d-4fcb-8cd5-21e2b831e54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2872e2dee74831a658fcfd044e04f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:25Z,use_quota=True,user_id='8d49718b7292422cbaea2fc758fb03a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7492d-07d8-4375-b5e9-6458b5f7c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7492d-07d8-4375-b5e9-6458b5f7c730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef1232a-b753-4139-b42c-2a663ed1c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef1232a-b753-4139-b42c-2a663ed1c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480d212d-ef7d-4fcb-8cd5-21e2b831e54f', 'volume_name': 'volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cd09ed-66d2-46af-91c9-07feeb21f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cd09ed-66d2-46af-91c9-07feeb21f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfcc88e-8844-4101-b394-6efd37cf6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:24 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Volume 480d212d-ef7d-4fcb-8cd5-21e2b831e54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f', 'volume_size': 1} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1675462924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480d212d-ef7d-4fcb-8cd5-21e2b831e54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2872e2dee74831a658fcfd044e04f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:25Z,use_quota=True,user_id='8d49718b7292422cbaea2fc758fb03a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Creating volume 480d212d-ef7d-4fcb-8cd5-21e2b831e54f {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:24 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:24 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f 1073741824 Apr 08 17:43:24 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:24 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:24 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4 Apr 08 17:43:24 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:25 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ff18187c-5f39-47a3-9e2a-c570d890aa64" returned: 0 in 0.425s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-ff18187c-5f39-47a3-9e2a-c570d890aa64" released by "delete_volume" :: held 1.018s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Created reservations ['874a8e8f-67bb-4027-8b0d-3750c14bb01b', '7d330eb3-e866-4f2c-b9d4-750dc52cec9a', '0816226d-7ebf-4a81-a23a-7fc2bb65d816', 'e8dbf77c-5edd-4f44-ab63-9bfef4e68177'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:25 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:25 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:25 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f 1073741824" returned: 0 in 0.531s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" returned: 0 in 0.448s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-ad3383e3-5137-4f01-b23a-4b83b6fe93c4" released by "delete_volume" :: held 0.980s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:25 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f Apr 08 17:43:25 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['aa6b51a1-499b-4e08-ab2d-81da35304b0e', 'f16883af-b67f-4a9a-afc0-2fa4ef9cd48d', '7e01e7e1-b1a6-4a0d-b3db-aeee65db5658', '7cb65b66-4043-4c13-81a2-8f6badcf7261'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:25 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:25 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:25 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.453s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:25 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Deleted volume successfully. Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9d5827a8-9988-4ce1-93d9-378d92d658d6 tempest-VolumesTestJSON-1101027009 None] Lock "cinder-ff18187c-5f39-47a3-9e2a-c570d890aa64-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:25 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfcc88e-8844-4101-b394-6efd37cf6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ecfe9-870f-4312-900b-7fb4fbcbe23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:25 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Volume volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f (480d212d-ef7d-4fcb-8cd5-21e2b831e54f): created successfully Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0ecfe9-870f-4312-900b-7fb4fbcbe23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Flow 'volume_create_manager' (5362a2d7-7865-49c7-a580-3162ffffb26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:25 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-954f3fcd-0457-4e32-9b30-e1f82e1114cc tempest-AbsoluteLimitsTests-1332224407 None] Created volume successfully. Apr 08 17:43:25 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:25 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0aa9c06e-7836-4d23-a4df-2919803192a1 tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-ad3383e3-5137-4f01-b23a-4b83b6fe93c4-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-bb222469-ed5f-4f3a-8a09-379a861b875b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "cinder-bb222469-ed5f-4f3a-8a09-379a861b875b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-quobyte-bb222469-ed5f-4f3a-8a09-379a861b875b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-bb222469-ed5f-4f3a-8a09-379a861b875b" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[43779c81-4699-419b-af61-3366c4f8444c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:26 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b Apr 08 17:43:26 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-b6d51212-851f-4043-b8a6-ea9c7e4bbff0-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-b6d51212-851f-4043-b8a6-ea9c7e4bbff0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd6420-ee5d-4b9c-b62c-d83eee655200]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:26 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 Apr 08 17:43:26 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:26 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b" returned: 0 in 0.520s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:26 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b Apr 08 17:43:26 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Acquiring lock "cinder-480d212d-ef7d-4fcb-8cd5-21e2b831e54f-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "cinder-480d212d-ef7d-4fcb-8cd5-21e2b831e54f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Acquiring lock "cinder-quobyte-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "cinder-quobyte-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968c238-b161-4ad0-adce-34f47fb70877]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" returned: 0 in 0.487s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0 Apr 08 17:43:27 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f Apr 08 17:43:27 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-bb222469-ed5f-4f3a-8a09-379a861b875b" returned: 0 in 0.459s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-bb222469-ed5f-4f3a-8a09-379a861b875b" released by "delete_volume" :: held 1.001s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Created reservations ['3ec437ee-a432-4815-bf53-5c8213efeb30', 'b66e62ba-c137-4142-ab83-9454eee1944c', '48b6c84f-90ac-41e8-9ebb-99a65f706e26', 'b5991906-a40e-45a3-88f7-3baadca11425'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:27 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" returned: 0 in 0.450s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f Apr 08 17:43:27 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-b6d51212-851f-4043-b8a6-ea9c7e4bbff0" released by "delete_volume" :: held 0.969s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=183,cinder:INSERT=50,cinder:UPDATE=253,cinder:DELETE=22 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['523e109c-fea6-46db-80a1-88496141a21c', 'a0af668c-372f-4156-b5ed-b73dd5170b7b', '5b3b95a5-03dd-422a-a103-e3651176d7ec', '55841d65-e04e-4a8a-b598-cc23f9f577f1'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:27 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-7be7cb42-5d9c-485a-ac3e-afece648206e-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-7be7cb42-5d9c-485a-ac3e-afece648206e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-7be7cb42-5d9c-485a-ac3e-afece648206e" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-7be7cb42-5d9c-485a-ac3e-afece648206e" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[48340484-0166-47e5-8a52-d313d4c2bae2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:27 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e Apr 08 17:43:27 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:27 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.459s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:27 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Deleted volume successfully. Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-58889ed1-7e16-4ba5-ae22-56c0e0dd6d1d tempest-VolumesTestJSON-1101027009 None] Lock "cinder-bb222469-ed5f-4f3a-8a09-379a861b875b-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:27 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" returned: 0 in 0.443s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "cinder-quobyte-480d212d-ef7d-4fcb-8cd5-21e2b831e54f" released by "delete_volume" :: held 0.937s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Created reservations ['0f5882a7-4748-4b37-9d06-5474d3cebf3c', '49d9a5e0-814e-44cf-bc71-71b9407cf4f9', 'dd678b7f-b71d-4749-82f5-58bcc43743a3', '38b2de91-6efe-4def-8cbb-a347e236745d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:28 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:28 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:28 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a28d6428-2961-4d16-bce6-468bdb6845bf tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-b6d51212-851f-4043-b8a6-ea9c7e4bbff0-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:28 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e" returned: 0 in 0.503s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:28 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e Apr 08 17:43:28 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-f35f6219-4dab-49c4-88bf-08dc677a087e-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "cinder-f35f6219-4dab-49c4-88bf-08dc677a087e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Acquiring lock "cinder-quobyte-f35f6219-4dab-49c4-88bf-08dc677a087e" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-f35f6219-4dab-49c4-88bf-08dc677a087e" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1dc5bc-6a2b-4eee-bf81-e663f5871361]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:28 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e Apr 08 17:43:28 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:28 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.579s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:28 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Deleted volume successfully. Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6f21af34-5b65-47b6-b2a7-cbfc235f10e3 tempest-AbsoluteLimitsTests-1332224407 None] Lock "cinder-480d212d-ef7d-4fcb-8cd5-21e2b831e54f-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:28 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7be7cb42-5d9c-485a-ac3e-afece648206e" returned: 0 in 0.456s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-7be7cb42-5d9c-485a-ac3e-afece648206e" released by "delete_volume" :: held 0.980s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['0b525a4a-54d3-4d1d-a5ad-e5e050ca8dd3', '0932c136-9262-4118-91a6-2e9834c303f5', '4992b217-b150-4c0e-8b79-10e5dce57619', '78203e94-976b-4dc1-8d3f-22a09b960aa7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:28 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:28 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-0e0b7278-21cb-45f8-86ad-89e425667b2a-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-0e0b7278-21cb-45f8-86ad-89e425667b2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "cinder-quobyte-0e0b7278-21cb-45f8-86ad-89e425667b2a" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-0e0b7278-21cb-45f8-86ad-89e425667b2a" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1899048f-6fab-44f1-b9a6-3dcfbbebfee2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:28 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a Apr 08 17:43:28 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:29 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e" returned: 0 in 0.585s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:29 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e Apr 08 17:43:29 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:29 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fd5267c7-2969-40db-b46d-f0beb699517d tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-7be7cb42-5d9c-485a-ac3e-afece648206e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:29 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a" returned: 0 in 0.518s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:29 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a Apr 08 17:43:29 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:29 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f35f6219-4dab-49c4-88bf-08dc677a087e" returned: 0 in 0.522s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "cinder-quobyte-f35f6219-4dab-49c4-88bf-08dc677a087e" released by "delete_volume" :: held 1.129s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:INSERT=75,cinder:SELECT=188,cinder:UPDATE=257,cinder:DELETE=23 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Created reservations ['715ad981-349d-4081-b915-f887ede12a04', '3dbb1ee2-9cfe-4f6c-8572-cb7a1ff45ee3', '99a1fb2a-e1db-4286-a289-8460d464f23c', '61461b79-f6ad-43f9-95b7-6751a28ba6f2'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:29 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:29 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:29 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-0e0b7278-21cb-45f8-86ad-89e425667b2a" returned: 0 in 0.442s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-quobyte-0e0b7278-21cb-45f8-86ad-89e425667b2a" released by "delete_volume" :: held 0.983s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Created reservations ['e2217ec3-ed83-4969-a2d3-ad91b3762782', '378f7be3-d70f-47ef-b661-1bce4af9fc8b', 'd71b033b-e9b4-4785-8356-76dbd007222d', 'cc36297a-bc1d-4b44-9a1c-5f4bb525b9bd'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:29 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:29 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:30 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.471s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:30 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Deleted volume successfully. Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4c59fd1a-85a5-45ad-8284-8f7b83861c0e tempest-VolumesTestJSON-1101027009 None] Lock "cinder-f35f6219-4dab-49c4-88bf-08dc677a087e-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:30 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.505s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:30 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Deleted volume successfully. Apr 08 17:43:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-af68ae61-d3bb-4899-86f8-9ff55d40524e tempest-CreateVolumesFromSourceVolumeTest-720657749 None] Lock "cinder-0e0b7278-21cb-45f8-86ad-89e425667b2a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ec13edfd-c14e-47e5-a2bf-9c75eb74363b tempest-GroupsTest-715516007 None] Group tempest-Group1-1665714428: creating Apr 08 17:43:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ec13edfd-c14e-47e5-a2bf-9c75eb74363b tempest-GroupsTest-715516007 None] Group tempest-Group1-1665714428: created successfully Apr 08 17:43:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ec13edfd-c14e-47e5-a2bf-9c75eb74363b tempest-GroupsTest-715516007 None] Create group completed successfully. Apr 08 17:43:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-95b3fb11-f3de-44e8-9e84-eae3b9038697 tempest-GroupsTest-715516007 None] Group tempest-Group2-1714115434: creating Apr 08 17:43:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-95b3fb11-f3de-44e8-9e84-eae3b9038697 tempest-GroupsTest-715516007 None] Group tempest-Group2-1714115434: created successfully Apr 08 17:43:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-95b3fb11-f3de-44e8-9e84-eae3b9038697 tempest-GroupsTest-715516007 None] Create group completed successfully. Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (351fef26-a561-4269-b979-607156fcc514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3133c65-a0a5-4744-8283-46e0c95d6fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3133c65-a0a5-4744-8283-46e0c95d6fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-597577311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fc78173-bc00-42fe-8dbf-2be45bf12174,host='devstack@QuobyteHD#QuobyteHD',id=3c31bd89-c35f-4db5-a47c-22294f458b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:36Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8fa7ef4-b196-4ebe-b64a-c2df3d4d8d39),volume_type_id=d8fa7ef4-b196-4ebe-b64a-c2df3d4d8d39)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7e2f15-700a-4317-8593-4bca85082a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7e2f15-700a-4317-8593-4bca85082a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe46cb-74de-4346-a77d-b4652db9b532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe46cb-74de-4346-a77d-b4652db9b532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c31bd89-c35f-4db5-a47c-22294f458b3c', 'volume_name': 'volume-3c31bd89-c35f-4db5-a47c-22294f458b3c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdd73e7-5279-4ca6-8de5-66e14b02c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdd73e7-5279-4ca6-8de5-66e14b02c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fce8302-7a1e-42d3-aad0-07ef135c22ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:35 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Volume 3c31bd89-c35f-4db5-a47c-22294f458b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c31bd89-c35f-4db5-a47c-22294f458b3c', 'volume_size': 1} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fc78173-bc00-42fe-8dbf-2be45bf12174,created_at=2026-04-08T15:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-597577311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fc78173-bc00-42fe-8dbf-2be45bf12174,host='devstack@QuobyteHD#QuobyteHD',id=3c31bd89-c35f-4db5-a47c-22294f458b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:36Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8fa7ef4-b196-4ebe-b64a-c2df3d4d8d39),volume_type_id=d8fa7ef4-b196-4ebe-b64a-c2df3d4d8d39)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Creating volume 3c31bd89-c35f-4db5-a47c-22294f458b3c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:35 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:35 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c 1073741824 Apr 08 17:43:35 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:36 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c 1073741824" returned: 0 in 0.509s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:36 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c Apr 08 17:43:36 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:36 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fce8302-7a1e-42d3-aad0-07ef135c22ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c31bd89-c35f-4db5-a47c-22294f458b3c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bacc15-5810-4328-a201-56f3cc504c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:36 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Volume volume-3c31bd89-c35f-4db5-a47c-22294f458b3c (3c31bd89-c35f-4db5-a47c-22294f458b3c): created successfully Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bacc15-5810-4328-a201-56f3cc504c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (351fef26-a561-4269-b979-607156fcc514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-13f9b459-fa5f-434a-9ebe-2486adb775ad tempest-GroupsTest-715516007 None] Created volume successfully. Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Flow 'volume_create_manager' (89c66203-2480-479b-9494-e3bc1e247f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e9285c-1c4b-4bad-b5f5-b5bfb19cf535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e9285c-1c4b-4bad-b5f5-b5bfb19cf535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1703842672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cc6bef-eb50-4b3c-8f5a-faa14e067622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cab94b61544915a4593f7af05a3d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:38Z,use_quota=True,user_id='f1af8fffdcc84b60ac3fa38891ed17a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e48b6-65e9-4383-a470-06fe301c79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e48b6-65e9-4383-a470-06fe301c79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f9b6cd-cbda-4c36-b75d-441e4a1f3f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f9b6cd-cbda-4c36-b75d-441e4a1f3f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cc6bef-eb50-4b3c-8f5a-faa14e067622', 'volume_name': 'volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09aa40d-ab5b-4f8b-bfa3-acdf472dc790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09aa40d-ab5b-4f8b-bfa3-acdf472dc790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2279dbea-5196-43ac-a2cc-9efe0496dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:37 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622', 'volume_size': 1} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1703842672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cc6bef-eb50-4b3c-8f5a-faa14e067622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cab94b61544915a4593f7af05a3d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:38Z,use_quota=True,user_id='f1af8fffdcc84b60ac3fa38891ed17a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Creating volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:37 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:37 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 1073741824 Apr 08 17:43:37 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Acquiring lock "cinder-quobyte-3c31bd89-c35f-4db5-a47c-22294f458b3c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-3c31bd89-c35f-4db5-a47c-22294f458b3c" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7ffdf-389a-4c47-afc0-7be54e732a4f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:38 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c Apr 08 17:43:38 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:38 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 1073741824" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:38 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:43:38 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:38 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:38 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c Apr 08 17:43:38 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:38 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.416s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2279dbea-5196-43ac-a2cc-9efe0496dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18eac43-f9dd-4426-8984-76a767a5d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:38 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Volume volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 (19cc6bef-eb50-4b3c-8f5a-faa14e067622): created successfully Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18eac43-f9dd-4426-8984-76a767a5d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Flow 'volume_create_manager' (89c66203-2480-479b-9494-e3bc1e247f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:38 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-552aee73-5263-441c-a524-0559b212728d tempest-VolumesActionsTest-912062841 None] Created volume successfully. Apr 08 17:43:39 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3c31bd89-c35f-4db5-a47c-22294f458b3c" returned: 0 in 0.407s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-3c31bd89-c35f-4db5-a47c-22294f458b3c" released by "delete_volume" :: held 0.943s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Created reservations ['5bcd60b0-303f-43c5-bd8a-6bc99ca29177'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:39 devstack cinder-volume[82664]: WARNING cinder.quota [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-559590429 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-559590429, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:43:39 devstack cinder-volume[82664]: WARNING cinder.quota [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-559590429 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-559590429, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Created reservations ['b8ee5fa5-7773-4862-a9b9-3a51fdb2f063', '1b273295-fda1-4e74-9208-c6681d54f777', '8a706afb-e656-45c9-af2b-0d70e74ca5f3', 'd980bd6d-4231-42a5-82b4-4bd9a3b8d265'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:39 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:39 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Created reservations ['33b8d2e8-1614-44c4-972e-aa6e76471c84'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:39 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:39 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:39 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.416s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a322ce11-ff06-4117-a44f-43f8debe9fc4 tempest-GroupsTest-715516007 None] Delete group completed successfully. Apr 08 17:43:39 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.425s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:39 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b6c7475a-5a05-46d4-9bf6-fd49a5df4bdb tempest-GroupsTest-715516007 None] Delete group completed successfully. Apr 08 17:43:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44a3eb0b-4bda-446a-9483-98dd2913913a tempest-GroupsTest-715516007 None] Group tempest-GroupsTest-Group-1427340321: creating Apr 08 17:43:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44a3eb0b-4bda-446a-9483-98dd2913913a tempest-GroupsTest-715516007 None] Group tempest-GroupsTest-Group-1427340321: created successfully Apr 08 17:43:40 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-44a3eb0b-4bda-446a-9483-98dd2913913a tempest-GroupsTest-715516007 None] Create group completed successfully. Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (824659eb-29c0-426d-84a9-35289d26884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b97b04-1658-42b3-902c-018391b77e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b97b04-1658-42b3-902c-018391b77e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1133064983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,host='devstack@QuobyteHD#QuobyteHD',id=89232de7-5d0a-4fcc-95b3-43c98dc65af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:42Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389c8887-9c32-4ddf-b1e9-95e80b00c1c3),volume_type_id=389c8887-9c32-4ddf-b1e9-95e80b00c1c3)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b5881-6467-415d-80ae-c94008b95dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b5881-6467-415d-80ae-c94008b95dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc1fedd-324e-4654-9f31-05fda5be9fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc1fedd-324e-4654-9f31-05fda5be9fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89232de7-5d0a-4fcc-95b3-43c98dc65af6', 'volume_name': 'volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1faf3bf-374f-4bbf-b817-bdff715fa862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1faf3bf-374f-4bbf-b817-bdff715fa862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbec147-d376-4506-885c-49ac94047b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:42 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Volume 89232de7-5d0a-4fcc-95b3-43c98dc65af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6', 'volume_size': 1} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,created_at=2026-04-08T15:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1133064983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,host='devstack@QuobyteHD#QuobyteHD',id=89232de7-5d0a-4fcc-95b3-43c98dc65af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:42Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389c8887-9c32-4ddf-b1e9-95e80b00c1c3),volume_type_id=389c8887-9c32-4ddf-b1e9-95e80b00c1c3)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Creating volume 89232de7-5d0a-4fcc-95b3-43c98dc65af6 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:42 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:42 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 1073741824 Apr 08 17:43:42 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:42 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 1073741824" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:42 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 Apr 08 17:43:42 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:43 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbec147-d376-4506-885c-49ac94047b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e675c958-02a0-41fd-9768-e3f57c8397c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Volume volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 (89232de7-5d0a-4fcc-95b3-43c98dc65af6): created successfully Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e675c958-02a0-41fd-9768-e3f57c8397c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (824659eb-29c0-426d-84a9-35289d26884e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ca15e131-b609-459b-8392-b8997497f064 tempest-GroupsTest-715516007 None] Created volume successfully. Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (315dbdb8-0d1b-435b-8364-a9342cf15229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d203e1-e6a3-49bf-930e-d31682317805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d203e1-e6a3-49bf-930e-d31682317805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289901802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,host='devstack@QuobyteHD#QuobyteHD',id=7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:44Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389c8887-9c32-4ddf-b1e9-95e80b00c1c3),volume_type_id=389c8887-9c32-4ddf-b1e9-95e80b00c1c3)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dd4e01-0e55-45ff-8f07-f9bf895a8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dd4e01-0e55-45ff-8f07-f9bf895a8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59153b9-7895-42cf-9088-52133cda16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59153b9-7895-42cf-9088-52133cda16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5', 'volume_name': 'volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5188cee2-9780-440c-b86f-c66e9cafc6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5188cee2-9780-440c-b86f-c66e9cafc6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce465040-8fb5-4066-8d80-8aded5e40f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Volume 7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5', 'volume_size': 1} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,created_at=2026-04-08T15:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289901802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fcb283-3d0e-473b-a6b7-0defb10be7fd,host='devstack@QuobyteHD#QuobyteHD',id=7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d8b1e48c76b48baaf5a84f42deeda7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:44Z,use_quota=True,user_id='22521ce87ae6438a9ecb33a3ff4db2cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(389c8887-9c32-4ddf-b1e9-95e80b00c1c3),volume_type_id=389c8887-9c32-4ddf-b1e9-95e80b00c1c3)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Creating volume 7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:44 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:44 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 1073741824 Apr 08 17:43:44 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:45 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 1073741824" returned: 0 in 0.537s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:45 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 Apr 08 17:43:45 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:45 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" returned: 0 in 0.551s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce465040-8fb5-4066-8d80-8aded5e40f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444a6302-a1e8-48c2-b1d1-c54ab0c27ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:45 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Volume volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 (7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5): created successfully Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444a6302-a1e8-48c2-b1d1-c54ab0c27ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Flow 'volume_create_manager' (315dbdb8-0d1b-435b-8364-a9342cf15229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6907bf48-b754-4078-9d45-a4f76db3c779 tempest-GroupsTest-715516007 None] Created volume successfully. Apr 08 17:43:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-27c08e94-9103-45cc-95e9-eff04ad9c4ae tempest-GroupsTest-715516007 None] Update group completed successfully. Apr 08 17:43:47 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1c5a541c-ead3-4e2d-a352-9691fb1d1d67 tempest-GroupsTest-715516007 None] Update group completed successfully. Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Acquiring lock "cinder-quobyte-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ee3f3-6302-4a52-bac9-58024555e4b9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:49 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 Apr 08 17:43:49 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:49 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:49 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5 Apr 08 17:43:49 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:50 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" returned: 0 in 0.403s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-7dd826b5-9bf9-4f69-a55a-2dfd3887d0c5" released by "delete_volume" :: held 0.939s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Acquiring lock "cinder-quobyte-89232de7-5d0a-4fcc-95b3-43c98dc65af6" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-89232de7-5d0a-4fcc-95b3-43c98dc65af6" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[404354b9-da83-4d59-8707-acf23e8efb14]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:50 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 Apr 08 17:43:50 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:50 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:50 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6 Apr 08 17:43:50 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:51 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89232de7-5d0a-4fcc-95b3-43c98dc65af6" returned: 0 in 0.456s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "cinder-quobyte-89232de7-5d0a-4fcc-95b3-43c98dc65af6" released by "delete_volume" :: held 1.046s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Created reservations ['bfddbd17-9a68-43da-8423-be2c37fae499'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:51 devstack cinder-volume[82664]: WARNING cinder.quota [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1827730713 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1827730713, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:43:51 devstack cinder-volume[82664]: WARNING cinder.quota [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1827730713 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1827730713, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Created reservations ['47d46c88-e573-4b80-ba05-e14828f86af6', '20516abc-8926-40cf-8641-b4cffb1d107e', 'ef38fdb7-7531-4cc8-9b1b-d2d0c8d19230', 'e61cfa36-bfa0-4a90-8f4d-8633933a4b28'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Created reservations ['5834509b-47f0-4a3a-b1fc-c7c89d956481', '87817aa0-01dc-42a5-8408-1e3c4d256044', '60705ed9-db22-45b9-8663-44aac03826f6', 'c244c79c-c4b2-4cde-bd44-5c7e49d8c4e1'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:51 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:43:51 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:51 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:51 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:43:51 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5f4a6413-8f32-497d-be40-7355feabb4ac tempest-GroupsTest-715516007 None] Delete group completed successfully. Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e77e02c9-eeb7-4e4b-9bb4-f2e6d3005394 tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" by "attach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e77e02c9-eeb7-4e4b-9bb4-f2e6d3005394 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" acquired by "attach_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e77e02c9-eeb7-4e4b-9bb4-f2e6d3005394 tempest-VolumesActionsTest-912062841 None] Attaching volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622 to instance 314546bc-0f5e-427b-b784-0da8ec220081 at mountpoint /dev/vdb on host None. Apr 08 17:43:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e77e02c9-eeb7-4e4b-9bb4-f2e6d3005394 tempest-VolumesActionsTest-912062841 None] Attach volume completed successfully. Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e77e02c9-eeb7-4e4b-9bb4-f2e6d3005394 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" released by "attach_volume" :: held 0.058s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d9e9b682-0610-402e-84fb-f5849b6f68cb tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" by "detach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d9e9b682-0610-402e-84fb-f5849b6f68cb tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:43:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d9e9b682-0610-402e-84fb-f5849b6f68cb tempest-VolumesActionsTest-912062841 None] Detaching volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622 from instance 314546bc-0f5e-427b-b784-0da8ec220081. Apr 08 17:43:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d9e9b682-0610-402e-84fb-f5849b6f68cb tempest-VolumesActionsTest-912062841 None] Detach volume completed successfully. Apr 08 17:43:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d9e9b682-0610-402e-84fb-f5849b6f68cb tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:43:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8cf50537-59bf-4a0e-a352-0e0799067b36 tempest-GroupsV314Test-1572402258 None] Group tempest-GroupsV314Test-Group-1240254399: creating Apr 08 17:43:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8cf50537-59bf-4a0e-a352-0e0799067b36 tempest-GroupsV314Test-1572402258 None] Group tempest-GroupsV314Test-Group-1240254399: created successfully Apr 08 17:43:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8cf50537-59bf-4a0e-a352-0e0799067b36 tempest-GroupsV314Test-1572402258 None] Create group completed successfully. Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Flow 'volume_create_manager' (ccd68328-08d6-44f1-a888-f4187e5d8ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb30318-cadb-4404-ba20-d1996187033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb30318-cadb-4404-ba20-d1996187033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006829842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e36fad6d-d6ce-48b4-8142-4af3d462aeb9,host='devstack@QuobyteHD#QuobyteHD',id=000b23da-a8fe-4c1f-8c67-b664ea3ac6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45972bee03c546bd900c8f9de09b0d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:57Z,use_quota=True,user_id='82e45d3b9bbd42a4a6b31d6a7cb4a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfed99df-9840-43d5-95fc-a6fb7905e6e3),volume_type_id=dfed99df-9840-43d5-95fc-a6fb7905e6e3)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd40e4d-0d24-4d81-a233-32f5b9f839d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd40e4d-0d24-4d81-a233-32f5b9f839d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41aa42e7-79ee-420e-8301-d4c5bdd69b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41aa42e7-79ee-420e-8301-d4c5bdd69b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000b23da-a8fe-4c1f-8c67-b664ea3ac6bd', 'volume_name': 'volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839a5e8b-6dd7-4263-b28d-e615b32ad12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839a5e8b-6dd7-4263-b28d-e615b32ad12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d8c79a-25b1-4f7d-934a-029f0c0d1fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:56 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Volume 000b23da-a8fe-4c1f-8c67-b664ea3ac6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd', 'volume_size': 1} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e36fad6d-d6ce-48b4-8142-4af3d462aeb9,created_at=2026-04-08T15:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006829842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e36fad6d-d6ce-48b4-8142-4af3d462aeb9,host='devstack@QuobyteHD#QuobyteHD',id=000b23da-a8fe-4c1f-8c67-b664ea3ac6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45972bee03c546bd900c8f9de09b0d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:43:57Z,use_quota=True,user_id='82e45d3b9bbd42a4a6b31d6a7cb4a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfed99df-9840-43d5-95fc-a6fb7905e6e3),volume_type_id=dfed99df-9840-43d5-95fc-a6fb7905e6e3)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Creating volume 000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:43:56 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:43:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:56 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd 1073741824 Apr 08 17:43:56 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:57 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd 1073741824" returned: 0 in 0.526s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:57 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:43:57 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:43:57 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.430s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d8c79a-25b1-4f7d-934a-029f0c0d1fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a739caf6-42e0-4efc-8b74-86049ffacf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:43:57 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Volume volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd (000b23da-a8fe-4c1f-8c67-b664ea3ac6bd): created successfully Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a739caf6-42e0-4efc-8b74-86049ffacf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:43:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Flow 'volume_create_manager' (ccd68328-08d6-44f1-a888-f4187e5d8ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:43:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f3b6088f-6830-46be-a37c-98e85685eaa5 tempest-GroupsV314Test-1572402258 None] Created volume successfully. Apr 08 17:43:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:43:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:43:59 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Cloning volume 000b23da-a8fe-4c1f-8c67-b664ea3ac6bd to volume 21b9cd73-5af6-47a3-8d3a-f0dd514fa84d Apr 08 17:43:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Creating offline snapshot 739a3206-19f5-4f35-be1f-9d98f958f488 of volume 000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:43:59 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad97e31-7cf0-4942-b5bc-23369a9d184d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:43:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:43:59 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:43:59 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:00 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.463s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:00 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 1G Apr 08 17:44:00 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:00 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 1G" returned: 0 in 0.548s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:00 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:00 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:01 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:01 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:44:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:01 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:01 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:01 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.433s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:01 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info Apr 08 17:44:01 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:02 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info" returned: 0 in 0.426s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:02 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:02 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info Apr 08 17:44:02 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:02 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.info" returned: 0 in 0.395s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Acquiring lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] snapshot: 739a3206-19f5-4f35-be1f-9d98f958f488, volume: 21b9cd73-5af6-47a3-8d3a-f0dd514fa84d, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee04719-87bd-4eb3-a9d6-2a685398c782]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:02 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:02 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:02 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:02 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:03 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cf0b68-4429-4890-9450-cc367f012a16]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:03 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:44:03 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:03 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:03 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.491s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:44:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:03 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d Apr 08 17:44:03 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:05 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" returned: 0 in 2.019s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:05 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8211aa-291f-4319-b3ea-07daba506f20]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:05 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:44:05 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:06 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.658s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:44:06 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Converted 1024.00 MB image at 506.81 MB/s Apr 08 17:44:06 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d is being set with open permissions: ugo+rw: NotImplementedError Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:06 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d Apr 08 17:44:06 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:06 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" released by "_copy_volume_from_snapshot" :: held 4.155s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Acquiring lock "cinder-quobyte-739a3206-19f5-4f35-be1f-9d98f958f488" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-739a3206-19f5-4f35-be1f-9d98f958f488" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Deleting offline snapshot 739a3206-19f5-4f35-be1f-9d98f958f488 of volume 000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] snapshot_file for this snap is: volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a22fd4b-3eec-45e4-9810-1e6d9fa2d88c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:06 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:06 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:07 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.455s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87c4ace-68f8-4436-87f6-88aaf8d590ed]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:07 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:44:07 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:07 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.473s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:07 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:07 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:08 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.448s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:08 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488 Apr 08 17:44:08 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:08 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd.739a3206-19f5-4f35-be1f-9d98f958f488" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-739a3206-19f5-4f35-be1f-9d98f958f488" released by "_delete_snapshot" :: held 1.830s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.843s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:08 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bc9cb1c3-141e-4245-919c-494e9e44b01a tempest-GroupsV314Test-1572402258 None] Create group from source-group-e36fad6d-d6ce-48b4-8142-4af3d462aeb9 completed successfully. Apr 08 17:44:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Acquiring lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:09 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c5552-0cfe-4f77-9058-a3655b08384e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:09 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d Apr 08 17:44:09 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:10 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:10 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d Apr 08 17:44:10 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:10 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-21b9cd73-5af6-47a3-8d3a-f0dd514fa84d" released by "delete_volume" :: held 0.898s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Created reservations ['a59e5696-3d40-48e4-9c2b-da5aedb4af6a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:10 devstack cinder-volume[82664]: WARNING cinder.quota [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-160523960 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-160523960, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:44:10 devstack cinder-volume[82664]: WARNING cinder.quota [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-160523960 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-160523960, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Created reservations ['cb5276e5-a3f7-4b32-93f2-1d1cfbf12d26', '6eaabe27-7567-4a83-9173-772a9cb5b661', '334e8a7c-a101-434c-97a1-fbd79c0404e3', '6ff72df9-8f5c-4773-bdba-8edf773c212d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:10 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:10 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Acquiring lock "cinder-quobyte-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a333a654-b990-44ab-a340-179422b64a58]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:11 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:44:11 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:11 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.431s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-cd1382b7-c81c-4bf4-b907-73f4b3db84f6 tempest-GroupsV314Test-1572402258 None] Delete group completed successfully. Apr 08 17:44:11 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.608s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:11 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd Apr 08 17:44:11 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:12 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" returned: 0 in 0.449s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Lock "cinder-quobyte-000b23da-a8fe-4c1f-8c67-b664ea3ac6bd" released by "delete_volume" :: held 1.085s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Created reservations ['3e2f16fc-0ade-49c3-96e3-72bf81967d74'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Created reservations ['5d0ac234-00f2-4000-a2cc-eee483afc62d', '7e9e0b9a-112f-4109-9ef4-07c353e62488', 'a7912e57-3377-4597-8abe-454996fd0091', '58212bba-9233-4b65-866f-48b5e08275e0'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:12 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:12 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:12 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.446s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:12 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-00692751-975e-458c-9dfb-f182a86e5eb0 tempest-GroupsV314Test-1572402258 None] Delete group completed successfully. Apr 08 17:44:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-33b13313-cb76-4e79-86dd-21a06e861684 tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" by "attach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-33b13313-cb76-4e79-86dd-21a06e861684 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" acquired by "attach_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-33b13313-cb76-4e79-86dd-21a06e861684 tempest-VolumesActionsTest-912062841 None] Attaching volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622 to instance bc189555-1643-4921-99b1-9b719bddf374 at mountpoint /dev/vdb on host None. Apr 08 17:44:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-33b13313-cb76-4e79-86dd-21a06e861684 tempest-VolumesActionsTest-912062841 None] Attach volume completed successfully. Apr 08 17:44:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-33b13313-cb76-4e79-86dd-21a06e861684 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622" released by "attach_volume" :: held 0.058s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea35588c-831b-4272-b093-688154e589b0 tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" by "detach_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea35588c-831b-4272-b093-688154e589b0 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ea35588c-831b-4272-b093-688154e589b0 tempest-VolumesActionsTest-912062841 None] Detaching volume 19cc6bef-eb50-4b3c-8f5a-faa14e067622 from instance bc189555-1643-4921-99b1-9b719bddf374. Apr 08 17:44:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ea35588c-831b-4272-b093-688154e589b0 tempest-VolumesActionsTest-912062841 None] Detach volume completed successfully. Apr 08 17:44:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea35588c-831b-4272-b093-688154e589b0 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Flow 'volume_create_manager' (7f2af163-0652-4e2c-9124-1db5d7fef7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295bc616-7bc6-4e89-8c04-be0755bf94db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295bc616-7bc6-4e89-8c04-be0755bf94db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-424395013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4550b0ec-1a35-48a3-bcd1-ba3b4c519246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6e5328a3547b9894d46f7df46d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:17Z,use_quota=True,user_id='418d71bd12954c61ab3caed78a2ccd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4691e598-43cb-4d91-820b-42750ae04d43),volume_type_id=4691e598-43cb-4d91-820b-42750ae04d43)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031ad70e-e537-4a47-9ec1-71ee9f178c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031ad70e-e537-4a47-9ec1-71ee9f178c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf2a1d2-3d0f-49dd-9b8c-946bbead4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf2a1d2-3d0f-49dd-9b8c-946bbead4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4550b0ec-1a35-48a3-bcd1-ba3b4c519246', 'volume_name': 'volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6af7b3-25e7-4f6b-834e-c1079d6bdc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6af7b3-25e7-4f6b-834e-c1079d6bdc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0f86af-d75c-4b3b-8877-cdaacd2b2cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:16 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Volume 4550b0ec-1a35-48a3-bcd1-ba3b4c519246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246', 'volume_size': 1} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-424395013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4550b0ec-1a35-48a3-bcd1-ba3b4c519246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6e5328a3547b9894d46f7df46d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:17Z,use_quota=True,user_id='418d71bd12954c61ab3caed78a2ccd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4691e598-43cb-4d91-820b-42750ae04d43),volume_type_id=4691e598-43cb-4d91-820b-42750ae04d43)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Creating volume 4550b0ec-1a35-48a3-bcd1-ba3b4c519246 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:44:16 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:44:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:16 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 1073741824 Apr 08 17:44:16 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:17 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 1073741824" returned: 0 in 0.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:17 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 Apr 08 17:44:17 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:17 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0f86af-d75c-4b3b-8877-cdaacd2b2cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18310350-5c13-44eb-b310-512a72481d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:17 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Volume volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 (4550b0ec-1a35-48a3-bcd1-ba3b4c519246): created successfully Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18310350-5c13-44eb-b310-512a72481d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Flow 'volume_create_manager' (7f2af163-0652-4e2c-9124-1db5d7fef7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-37369a95-b158-4444-a761-fd9fabcba779 tempest-VolumeTypesAccessTest-141940592 None] Created volume successfully. Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Acquiring lock "cinder-4550b0ec-1a35-48a3-bcd1-ba3b4c519246-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "cinder-4550b0ec-1a35-48a3-bcd1-ba3b4c519246-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Acquiring lock "cinder-quobyte-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "cinder-quobyte-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d6f8e-7f8c-4840-96f9-5e80a8a7d264]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:18 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 Apr 08 17:44:18 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:19 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" returned: 0 in 0.498s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:19 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246 Apr 08 17:44:19 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:19 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" returned: 0 in 0.411s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "cinder-quobyte-4550b0ec-1a35-48a3-bcd1-ba3b4c519246" released by "delete_volume" :: held 0.928s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:19 devstack cinder-volume[82664]: WARNING cinder.quota [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1774501093 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1774501093, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:44:19 devstack cinder-volume[82664]: WARNING cinder.quota [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1774501093 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1774501093, it is now deprecated. Please use the default quota class for default quota. Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Created reservations ['af647635-9d9e-4c63-814c-1f90098221f2', '96fe6867-b226-445f-81f5-136b949e398e', '8294d263-cfd5-4af7-9903-017d00091834', '2a074f2d-ada7-40c1-a7a9-f5e6d8563323'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:19 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:19 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:20 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.473s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:20 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Deleted volume successfully. Apr 08 17:44:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23158f83-a789-47e7-9159-551e5695790e tempest-VolumeTypesAccessTest-141940592 None] Lock "cinder-4550b0ec-1a35-48a3-bcd1-ba3b4c519246-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1af2d39-bffb-4ef3-99a3-42ec284bf54a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:22 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:22 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:22 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.500s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c89f4b6-2bbd-4d2d-acef-4a4562968226]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:22 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:22 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:23 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.498s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.b3d10ed6-83c0-4f5b-a455-8ad1de13c4537xfn0sng.img {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:23 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.b3d10ed6-83c0-4f5b-a455-8ad1de13c4537xfn0sng.img Apr 08 17:44:23 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:25 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.b3d10ed6-83c0-4f5b-a455-8ad1de13c4537xfn0sng.img" returned: 0 in 2.037s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[17db401c-eac8-45cd-9ab4-f52824607488]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:25 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:25 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:26 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.681s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:26 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.b3d10ed6-83c0-4f5b-a455-8ad1de13c4537xfn0sng.img {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:44:26 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Converted 1024.00 MB image at 502.33 MB/s Apr 08 17:44:26 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] b3d10ed6-83c0-4f5b-a455-8ad1de13c453 was raw, no need to convert to raw {{(pid=82664) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=118,cinder:INSERT=30,cinder:UPDATE=146,cinder:DELETE=8 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Flow 'volume_create_manager' (045f1635-37d1-4627-842e-ab3a0c3af38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa80522-16b8-405e-aa5b-351a4d721757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa80522-16b8-405e-aa5b-351a4d721757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-889797283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4651b35a0a1f4beaafc95c0197a0296e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:29Z,use_quota=True,user_id='747ce66d306644aca4ecaccfdb21a1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1fd9b4-38d9-49a6-ad96-e358ea3871db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1fd9b4-38d9-49a6-ad96-e358ea3871db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f0eb27-0b40-4c51-a6a1-d19f27699345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f0eb27-0b40-4c51-a6a1-d19f27699345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'volume_name': 'volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449911af-1434-47e5-8704-f1bb6b5b1064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449911af-1434-47e5-8704-f1bb6b5b1064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c27b23e-70fb-43c4-a32d-8aa15baebbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:29 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Volume 89d429a2-f5ee-44e2-a7ae-1bedf2bc868b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'volume_size': 1} Apr 08 17:44:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:34 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=104,cinder:SELECT=103,cinder:INSERT=22,cinder:DELETE=3 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.458s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Uploaded volume to glance image-id: b3d10ed6-83c0-4f5b-a455-8ad1de13c453. {{(pid=82664) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.566s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-889797283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4651b35a0a1f4beaafc95c0197a0296e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:29Z,use_quota=True,user_id='747ce66d306644aca4ecaccfdb21a1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Creating volume 89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:44:35 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:44:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-aee0d8b8-dd63-46b9-b1ff-74d0b09c0797 tempest-VolumesActionsTest-912062841 None] Copy volume to image completed successfully. Apr 08 17:44:35 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b 1073741824 Apr 08 17:44:35 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:36 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b 1073741824" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:36 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:36 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:36 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.433s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c27b23e-70fb-43c4-a32d-8aa15baebbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cc4d48-4ee5-4fdd-873d-f8c3e6f52836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:36 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Volume volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b (89d429a2-f5ee-44e2-a7ae-1bedf2bc868b): created successfully Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cc4d48-4ee5-4fdd-873d-f8c3e6f52836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Flow 'volume_create_manager' (045f1635-37d1-4627-842e-ab3a0c3af38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4769f5ac-1641-4fc6-ba54-a60fc79cfe74 tempest-VolumesCloneTest-833318061 None] Created volume successfully. Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1020a-ff16-44c7-88da-e8a105947ac9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:37 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:37 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:44:37 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Flow 'volume_create_manager' (e987dc24-819f-47ac-bc70-52df2aa2cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e0289-9556-49d0-a5b3-87df2090b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024e0289-9556-49d0-a5b3-87df2090b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1045539041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2055ec-e043-4d75-a3f4-84549f6165e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4651b35a0a1f4beaafc95c0197a0296e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:38Z,use_quota=True,user_id='747ce66d306644aca4ecaccfdb21a1de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63ea1d9-0384-49b3-a527-8ef768d1de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63ea1d9-0384-49b3-a527-8ef768d1de3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ce690a-009a-4a4b-9baa-42f1e75aa297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.559s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a0b0a-7b7e-4fd9-aecc-f42d1f3c3e69]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ce690a-009a-4a4b-9baa-42f1e75aa297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d2055ec-e043-4d75-a3f4-84549f6165e6', 'volume_name': 'volume-4d2055ec-e043-4d75-a3f4-84549f6165e6', 'volume_size': 2, 'source_volid': '89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f829691-705d-4617-b842-f99c03c40414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f829691-705d-4617-b842-f99c03c40414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d909c288-64aa-4939-996e-2dbfd15be357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:37 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Volume 4d2055ec-e043-4d75-a3f4-84549f6165e6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d2055ec-e043-4d75-a3f4-84549f6165e6', 'volume_size': 2, 'source_volid': '89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'source_volstatus': 'available'} Apr 08 17:44:37 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:38 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:38 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:38 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.457s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:38 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img Apr 08 17:44:38 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:40 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img" returned: 0 in 1.819s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcddbfa-1e65-4df6-b0c7-6b753a610d45]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:40 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:40 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:40 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:44:40 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Converted 1024.00 MB image at 562.49 MB/s Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] 2a43b124-2374-455c-948a-ffef30fcad8b was raw, converting to qcow2 {{(pid=82664) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2aeb78-8a47-49c9-9a90-4ac5eb9604f1]: (4, 'raw') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:40 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img Apr 08 17:44:40 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:41 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:41 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img Apr 08 17:44:41 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:41 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img" returned: 1 in 0.463s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img' failed. Not Retrying. {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 08 17:44:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:41 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v Apr 08 17:44:41 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:42 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v" returned: 0 in 0.406s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:42 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Image conversion details: src /opt/stack/data/cinder/conversion/19cc6bef-eb50-4b3c-8f5a-faa14e067622.temp_image.2a43b124-2374-455c-948a-ffef30fcad8bgga0wflf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:44:42 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 08 17:44:42 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fea640-e8a5-42ad-8f2e-928871d82492]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:42 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v Apr 08 17:44:42 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:42 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vmgv5j1v" returned: 0 in 0.454s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.035s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Uploaded volume to glance image-id: 2a43b124-2374-455c-948a-ffef30fcad8b. {{(pid=82664) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.425s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:43 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Cloning volume 89d429a2-f5ee-44e2-a7ae-1bedf2bc868b to volume 4d2055ec-e043-4d75-a3f4-84549f6165e6 Apr 08 17:44:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c11f77f7-f54f-436e-90fa-e40fd886a802 tempest-VolumesActionsTest-912062841 None] Copy volume to image completed successfully. Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Creating offline snapshot a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 of volume 89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff8560-5d95-45f4-b557-f75f472cb9e2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:43 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:43 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:43 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:43 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 1G Apr 08 17:44:43 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Acquiring lock "cinder-quobyte-19cc6bef-eb50-4b3c-8f5a-faa14e067622" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "cinder-quobyte-19cc6bef-eb50-4b3c-8f5a-faa14e067622" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a08efb-9d0b-4234-9d94-6d272837c068]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:44 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:44 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:44 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 1G" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:44 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:44 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:44 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.492s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:44 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622 Apr 08 17:44:44 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:44 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.436s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:44 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 is being set with open permissions: ugo+rw Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:44 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:44 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:44 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-19cc6bef-eb50-4b3c-8f5a-faa14e067622" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "cinder-quobyte-19cc6bef-eb50-4b3c-8f5a-faa14e067622" released by "delete_volume" :: held 0.941s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Created reservations ['00f836c6-5cd4-4fbe-a3d8-255fb0a61e42', 'd2f1c330-3161-4d69-b2a8-673ca7c2d921', '7ebaaa09-1bf9-4766-892b-e4a4ce1596e9', '3aca9973-17c8-4a0b-8601-2c7adca51dec'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:45 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:45 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:45 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:45 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info Apr 08 17:44:45 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:45 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.448s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Deleted volume successfully. Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-863a352c-4875-415d-b17f-939cc86bb1a3 tempest-VolumesActionsTest-912062841 None] Lock "cinder-19cc6bef-eb50-4b3c-8f5a-faa14e067622-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:45 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info" returned: 0 in 0.447s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:45 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info is being set with open permissions: ugo+rw Apr 08 17:44:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:45 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info Apr 08 17:44:45 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:46 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.info" returned: 0 in 0.431s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] snapshot: a3d8c9ce-0f75-42ed-a292-651bc24dfbc4, volume: 4d2055ec-e043-4d75-a3f4-84549f6165e6, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ca234-fb5b-4af2-9170-64ae62bc4ae8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:46 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:46 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:46 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.493s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[279bf827-5768-46ea-979c-d64f7828fb49]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:46 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:46 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:47 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.535s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:47 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:44:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:47 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 Apr 08 17:44:47 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:49 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6" returned: 0 in 2.277s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:49 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed675b3-e77b-4263-869f-8f6f66783443]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:49 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:49 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Flow 'volume_create_manager' (65f7c585-418d-4782-b3fa-619c3ec4bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa21117-8456-4ccc-81f8-22bcf03f5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa21117-8456-4ccc-81f8-22bcf03f5215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1411940763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaaf832-0b70-4221-a0df-0cac05a0568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feaca35849194ed5b26c6d7f2b3faa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:50Z,use_quota=True,user_id='cc39966454a545699057df8d13438532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cdf316-a5d1-4c8c-be0d-f498e02d55c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cdf316-a5d1-4c8c-be0d-f498e02d55c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e873200-9eb8-4593-a9e0-6cb07ab6b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e873200-9eb8-4593-a9e0-6cb07ab6b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaaf832-0b70-4221-a0df-0cac05a0568f', 'volume_name': 'volume-acaaf832-0b70-4221-a0df-0cac05a0568f', 'volume_size': 2}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2af645d-1d9a-439e-9ac5-9b32ef12f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2af645d-1d9a-439e-9ac5-9b32ef12f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660ff161-b5e4-4a47-b8c7-343840dbf2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:50 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Volume acaaf832-0b70-4221-a0df-0cac05a0568f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaaf832-0b70-4221-a0df-0cac05a0568f', 'volume_size': 2} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:50 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.660s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:44:50 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Converted 1024.00 MB image at 449.42 MB/s Apr 08 17:44:50 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 is being set with open permissions: ugo+rw Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:50 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 Apr 08 17:44:50 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:50 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6" returned: 0 in 0.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" released by "_copy_volume_from_snapshot" :: held 4.430s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-quobyte-a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Deleting offline snapshot a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 of volume 89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] snapshot_file for this snap is: volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[27262a2f-fc7a-4251-bdbe-86f50f7c0e6d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:50 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:50 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:51 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.470s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b05d1d7-273e-4e19-abc6-c49e84152164]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:51 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:51 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:51 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.472s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:51 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:51 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:52 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.450s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:52 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4 Apr 08 17:44:52 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:52 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b.a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-a3d8c9ce-0f75-42ed-a292-651bc24dfbc4" released by "_delete_snapshot" :: held 1.843s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.181s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1411940763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaaf832-0b70-4221-a0df-0cac05a0568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feaca35849194ed5b26c6d7f2b3faa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:50Z,use_quota=True,user_id='cc39966454a545699057df8d13438532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Creating volume acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:44:52 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f 2147483648 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d909c288-64aa-4939-996e-2dbfd15be357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2055ec-e043-4d75-a3f4-84549f6165e6', 'volume_size': 2, 'source_volid': '89d429a2-f5ee-44e2-a7ae-1bedf2bc868b', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:52 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f 2147483648 Apr 08 17:44:52 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6459d36-3e93-4482-80b9-11c620cd20de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:52 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Volume volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 (4d2055ec-e043-4d75-a3f4-84549f6165e6): created successfully Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6459d36-3e93-4482-80b9-11c620cd20de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:52 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Flow 'volume_create_manager' (e987dc24-819f-47ac-bc70-52df2aa2cad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:52 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5f68c9a3-303e-4b7a-a89f-1daa2a42a3a3 tempest-VolumesCloneTest-833318061 None] Created volume successfully. Apr 08 17:44:53 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f 2147483648" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:53 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f Apr 08 17:44:53 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:53 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f" returned: 0 in 0.415s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660ff161-b5e4-4a47-b8c7-343840dbf2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaaf832-0b70-4221-a0df-0cac05a0568f', 'volume_size': 2}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae5b942-74db-41bc-81ab-e7657bb9b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:53 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Volume volume-acaaf832-0b70-4221-a0df-0cac05a0568f (acaaf832-0b70-4221-a0df-0cac05a0568f): created successfully Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae5b942-74db-41bc-81ab-e7657bb9b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Flow 'volume_create_manager' (65f7c585-418d-4782-b3fa-619c3ec4bb33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-465ac3fd-8c31-4176-a9aa-1cd8222fa938 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Created volume successfully. Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-4d2055ec-e043-4d75-a3f4-84549f6165e6-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "cinder-4d2055ec-e043-4d75-a3f4-84549f6165e6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a91d1-7c8d-46dd-a170-3ffe90d354d1]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:53 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 Apr 08 17:44:53 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Creating offline snapshot 309fb286-5f57-4e71-bfd5-fe60d5ff89ba of volume acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f2cb3-afef-4863-bf4d-59c339c381e3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:54 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6" returned: 0 in 0.509s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:54 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f Apr 08 17:44:54 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:54 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6 Apr 08 17:44:54 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:54 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f" returned: 0 in 0.455s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba 2G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:54 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4d2055ec-e043-4d75-a3f4-84549f6165e6" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-4d2055ec-e043-4d75-a3f4-84549f6165e6" released by "delete_volume" :: held 0.951s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:54 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba 2G Apr 08 17:44:54 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Created reservations ['deb7eb52-4436-45c6-b80b-9e8978dcbd46', '363dfaff-bcfa-4609-b405-73e991ed19e1', '30312056-e38b-4ddc-9c9b-5514c5c7524d', '400d531c-7eb0-443e-ae75-251a361a4dad'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:54 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:54 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:54 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "cinder-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Acquiring lock "cinder-quobyte-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09701df-257e-4f93-873a-6ff86bf64467]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:55 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:55 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:55 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba 2G" returned: 0 in 0.525s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acaaf832-0b70-4221-a0df-0cac05a0568f -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:55 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.446s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Deleted volume successfully. Apr 08 17:44:55 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acaaf832-0b70-4221-a0df-0cac05a0568f -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba Apr 08 17:44:55 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-aa97d8c7-87bf-40f1-b4d0-6ce052ee6364 tempest-VolumesCloneTest-833318061 None] Lock "cinder-4d2055ec-e043-4d75-a3f4-84549f6165e6-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:55 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.492s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:55 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b Apr 08 17:44:55 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:55 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acaaf832-0b70-4221-a0df-0cac05a0568f -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba" returned: 0 in 0.452s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:55 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba is being set with open permissions: ugo+rw Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:55 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba Apr 08 17:44:55 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:55 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "cinder-quobyte-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b" released by "delete_volume" :: held 0.924s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:55 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Created reservations ['68975f31-795b-413f-98a1-ba1cce5b7f55', 'c3185450-1f9f-4b14-a0fd-9409ccce412a', 'b6daaac5-edeb-47d5-9743-d545da45d67b', '404d07a0-6332-4531-bfb9-43d0957e4915'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:56 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:44:56 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:56 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba" returned: 0 in 0.429s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:56 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info Apr 08 17:44:56 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:56 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.487s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:44:56 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Deleted volume successfully. Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2a1ce24c-dc71-458c-a43c-67ef67979ce4 tempest-VolumesCloneTest-833318061 None] Lock "cinder-89d429a2-f5ee-44e2-a7ae-1bedf2bc868b-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:56 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info" returned: 0 in 0.460s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:56 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info is being set with open permissions: ugo+rw Apr 08 17:44:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:56 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info Apr 08 17:44:56 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:57 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.info" returned: 0 in 0.471s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0ae66a90-608d-46e8-a266-166e43386717 tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Create snapshot completed successfully Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "cinder-309fb286-5f57-4e71-bfd5-fe60d5ff89ba-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-309fb286-5f57-4e71-bfd5-fe60d5ff89ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "cinder-quobyte-309fb286-5f57-4e71-bfd5-fe60d5ff89ba" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-309fb286-5f57-4e71-bfd5-fe60d5ff89ba" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Deleting offline snapshot 309fb286-5f57-4e71-bfd5-fe60d5ff89ba of volume acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] snapshot_file for this snap is: volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[792351a9-758b-4509-b7b1-365fd6dd10ac]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:57 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba Apr 08 17:44:57 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:58 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba" returned: 0 in 0.510s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acaaf832-0b70-4221-a0df-0cac05a0568f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c0cea-5ffc-4eb6-bbb6-7df9d6736d22]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:58 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f Apr 08 17:44:58 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:58 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f" returned: 0 in 0.511s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:58 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba Apr 08 17:44:58 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:59 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba" returned: 0 in 0.510s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:59 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba Apr 08 17:44:59 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (d68286f6-e2f2-41b6-b526-94d411431a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7320ef24-b80d-4019-b0aa-1de7425a8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7320ef24-b80d-4019-b0aa-1de7425a8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-432812842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87625f6-0600-4b49-9d6f-f490b6a161ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:59Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa778c3b-5dd8-40e7-b2f3-dbd68fb8b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa778c3b-5dd8-40e7-b2f3-dbd68fb8b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8e9f47-bfcb-4df7-b718-49c7f50b277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8e9f47-bfcb-4df7-b718-49c7f50b277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87625f6-0600-4b49-9d6f-f490b6a161ea', 'volume_name': 'volume-e87625f6-0600-4b49-9d6f-f490b6a161ea', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b96c253-b77f-4e7e-a1ef-b69d5e8c81fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b96c253-b77f-4e7e-a1ef-b69d5e8c81fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6b42a0-5238-4d66-8b45-5ebf05d47bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:44:59 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Volume e87625f6-0600-4b49-9d6f-f490b6a161ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87625f6-0600-4b49-9d6f-f490b6a161ea', 'volume_size': 1} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-432812842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87625f6-0600-4b49-9d6f-f490b6a161ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:44:59Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Creating volume e87625f6-0600-4b49-9d6f-f490b6a161ea {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:44:59 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:59 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea 1073741824 Apr 08 17:44:59 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:44:59 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f.309fb286-5f57-4e71-bfd5-fe60d5ff89ba" returned: 0 in 0.415s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-309fb286-5f57-4e71-bfd5-fe60d5ff89ba" released by "_delete_snapshot" :: held 2.001s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" released by "delete_snapshot" :: held 2.013s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Created reservations ['af42fc75-7bdf-4091-abe2-78271523432c', 'd40d5b45-704d-43f3-b2c4-3bf5a582f4c2', '9a8b1d38-2389-473a-90b3-1d9b9ec4ca64', 'e440d409-9ecf-4ace-aeb9-532cead4f059'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:44:59 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Delete snapshot completed successfully. Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d8ab07aa-1ac1-4767-872f-085d6316e16e tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-309fb286-5f57-4e71-bfd5-fe60d5ff89ba-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:44:59 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea 1073741824" returned: 0 in 0.493s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:44:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:44:59 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea Apr 08 17:44:59 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:00 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea" returned: 0 in 0.411s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6b42a0-5238-4d66-8b45-5ebf05d47bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87625f6-0600-4b49-9d6f-f490b6a161ea', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4942af14-bdce-4ab2-b580-8ae3455e5b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:00 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Volume volume-e87625f6-0600-4b49-9d6f-f490b6a161ea (e87625f6-0600-4b49-9d6f-f490b6a161ea): created successfully Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4942af14-bdce-4ab2-b580-8ae3455e5b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (d68286f6-e2f2-41b6-b526-94d411431a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:00 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1d4ad4f8-1014-477f-803b-1c3dc22a06e4 tempest-VolumesListTestJSON-1736134209 None] Created volume successfully. Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "cinder-acaaf832-0b70-4221-a0df-0cac05a0568f-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-acaaf832-0b70-4221-a0df-0cac05a0568f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d93512-9cb4-4942-8fa7-028ff37ccef9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:00 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f Apr 08 17:45:00 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:01 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f" returned: 0 in 0.470s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:01 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f Apr 08 17:45:01 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (92af1f8b-b9e8-4f27-9234-f0996bd6a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf5208e-3abc-4666-88bb-abec2daeea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf5208e-3abc-4666-88bb-abec2daeea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134889195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179922ce-39b6-42c7-aec1-661358c1d828,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:01Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed56be2a-0474-480b-91dd-05f192c8cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed56be2a-0474-480b-91dd-05f192c8cd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690c0d70-a094-474a-8af4-9c6837a975b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690c0d70-a094-474a-8af4-9c6837a975b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179922ce-39b6-42c7-aec1-661358c1d828', 'volume_name': 'volume-179922ce-39b6-42c7-aec1-661358c1d828', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44730f6-9af8-4752-adcd-d777e19a6254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44730f6-9af8-4752-adcd-d777e19a6254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb34e8d-39a5-4714-bc6d-355aafb036c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Volume 179922ce-39b6-42c7-aec1-661358c1d828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179922ce-39b6-42c7-aec1-661358c1d828', 'volume_size': 1} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134889195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179922ce-39b6-42c7-aec1-661358c1d828,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:01Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Creating volume 179922ce-39b6-42c7-aec1-661358c1d828 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:01 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:01 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 1073741824 Apr 08 17:45:01 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:01 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-acaaf832-0b70-4221-a0df-0cac05a0568f" returned: 0 in 0.449s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-quobyte-acaaf832-0b70-4221-a0df-0cac05a0568f" released by "delete_volume" :: held 0.956s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Created reservations ['12c6b216-9b08-41a9-97c1-a5479ea5efa7', '0bfb9042-bff2-4c3b-a6af-ceee3bc92d12', '0fb3951e-74ca-41a8-81fb-d1441f05417e', '5d141e9c-d8f0-4d92-815c-b799b931c176'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:01 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:01 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:02 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 1073741824" returned: 0 in 0.560s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:02 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 Apr 08 17:45:02 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:02 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.442s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Deleted volume successfully. Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8536cf7b-6042-48a7-b50f-a7b4efef9ccd tempest-VolumesSnapshotNegativeTestJSON-1020670457 None] Lock "cinder-acaaf832-0b70-4221-a0df-0cac05a0568f-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:02 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828" returned: 0 in 0.497s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb34e8d-39a5-4714-bc6d-355aafb036c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179922ce-39b6-42c7-aec1-661358c1d828', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d499e11-d15d-4917-b8f6-0ff50fa3917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:02 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Volume volume-179922ce-39b6-42c7-aec1-661358c1d828 (179922ce-39b6-42c7-aec1-661358c1d828): created successfully Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d499e11-d15d-4917-b8f6-0ff50fa3917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (92af1f8b-b9e8-4f27-9234-f0996bd6a56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-13275b77-a92f-4c01-af75-ccf8413762ce tempest-VolumesListTestJSON-1736134209 None] Created volume successfully. Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:02 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:02 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:03 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.462s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (d0a9d72b-00af-47d2-9c47-362e2d2031c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3894e00-5075-45cc-bf99-d772b30d9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3894e00-5075-45cc-bf99-d772b30d9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783712308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:03Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b45403a-a51e-451d-babd-9619c5918d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b45403a-a51e-451d-babd-9619c5918d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41999e6-a289-45a2-83eb-8c510175c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41999e6-a289-45a2-83eb-8c510175c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c', 'volume_name': 'volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d914e813-9bfc-47f4-b005-70ee01987d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d914e813-9bfc-47f4-b005-70ee01987d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a362145-7373-44d8-8597-47e52511ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Volume 4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c', 'volume_size': 1} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783712308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:03Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Creating volume 4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:03 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:03 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c 1073741824 Apr 08 17:45:03 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (d03973bc-8767-409f-bf80-d543f3810614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3700f0bb-bd0b-4b67-bb0a-032636b6e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3700f0bb-bd0b-4b67-bb0a-032636b6e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585550653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03172dfd-ce9c-4089-9f52-c331e04fc22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a47ea-b5fd-4de9-b636-6940db25165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a47ea-b5fd-4de9-b636-6940db25165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06537794-e521-4b15-94ac-c81872e8924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06537794-e521-4b15-94ac-c81872e8924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03172dfd-ce9c-4089-9f52-c331e04fc22a', 'volume_name': 'volume-03172dfd-ce9c-4089-9f52-c331e04fc22a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51ca3e3-8d83-493d-a996-dae42f8e07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51ca3e3-8d83-493d-a996-dae42f8e07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af228d3-d36b-41b3-8cea-d26b33584460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Volume 03172dfd-ce9c-4089-9f52-c331e04fc22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03172dfd-ce9c-4089-9f52-c331e04fc22a', 'volume_size': 1} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (cbbdcf8c-13fa-407d-9ed1-c984b512b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedbbfb-1c7b-44c1-b112-abe6a375f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedbbfb-1c7b-44c1-b112-abe6a375f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371496907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5522981-cca0-428d-a3c0-c539bb04cb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b96203-3d35-4c7c-8c7b-4c3393515e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b96203-3d35-4c7c-8c7b-4c3393515e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edf2ab7-bc29-4f90-a4c9-0214059ac905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edf2ab7-bc29-4f90-a4c9-0214059ac905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5522981-cca0-428d-a3c0-c539bb04cb72', 'volume_name': 'volume-f5522981-cca0-428d-a3c0-c539bb04cb72', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cedf473-1ebd-4a8f-9f7d-1ffdb5b6e36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cedf473-1ebd-4a8f-9f7d-1ffdb5b6e36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963e269-066f-420f-b505-1ae8695ca70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:03 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Volume f5522981-cca0-428d-a3c0-c539bb04cb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5522981-cca0-428d-a3c0-c539bb04cb72', 'volume_size': 1} Apr 08 17:45:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (3e9284ef-a317-4ec8-9b8f-8c98815d83e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:04 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4701ba-a744-4926-8ff2-a5710c7d4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4701ba-a744-4926-8ff2-a5710c7d4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1808124761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d636980-b279-4376-8a37-ff3268201b3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c1f94-6e49-4806-aa92-1968af76b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5c1f94-6e49-4806-aa92-1968af76b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14322fff-e66f-4b01-9b90-b96aae053cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14322fff-e66f-4b01-9b90-b96aae053cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d636980-b279-4376-8a37-ff3268201b3a', 'volume_name': 'volume-2d636980-b279-4376-8a37-ff3268201b3a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e4c746-b8e6-43ef-8445-bf1285eb92da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e4c746-b8e6-43ef-8445-bf1285eb92da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b946e1-760c-4dea-aede-8124dc9c3113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Volume 2d636980-b279-4376-8a37-ff3268201b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d636980-b279-4376-8a37-ff3268201b3a', 'volume_size': 1} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c 1073741824" returned: 0 in 0.605s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (5b5f4a60-c376-4f4f-bb34-68ee8dacc0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1875d469-c34c-455c-9f00-8c3f08c5ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1875d469-c34c-455c-9f00-8c3f08c5ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1142286423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adc1f74-15d3-4879-a5c9-f4d2c642c243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adc1f74-15d3-4879-a5c9-f4d2c642c243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b2b82-56b5-4069-abeb-2688a04d024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b2b82-56b5-4069-abeb-2688a04d024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c', 'volume_name': 'volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17879994-2f2b-4853-8d4e-760a89f2189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17879994-2f2b-4853-8d4e-760a89f2189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360a62b6-f1ae-48ea-aa8c-fe9f153aa449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Volume 1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c', 'volume_size': 1} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:04 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c Apr 08 17:45:04 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (1e378ff1-a906-4fbc-a61f-184a50703969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4f008-5789-4e30-9c75-77db5b57e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb4f008-5789-4e30-9c75-77db5b57e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034928951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20374f0-d8e0-45e2-be83-c1201076cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24652570-dbe8-47f3-8746-f444f7625fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24652570-dbe8-47f3-8746-f444f7625fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e8336-bd83-4842-9603-70f7f19d3e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e8336-bd83-4842-9603-70f7f19d3e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20374f0-d8e0-45e2-be83-c1201076cf9d', 'volume_name': 'volume-a20374f0-d8e0-45e2-be83-c1201076cf9d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb00a5-e333-4e8f-8aae-f08df977ad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fb00a5-e333-4e8f-8aae-f08df977ad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe21920-49e2-4053-9222-df2ff7b16416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Volume a20374f0-d8e0-45e2-be83-c1201076cf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20374f0-d8e0-45e2-be83-c1201076cf9d', 'volume_size': 1} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:04 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585550653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03172dfd-ce9c-4089-9f52-c331e04fc22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Creating volume 03172dfd-ce9c-4089-9f52-c331e04fc22a {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a362145-7373-44d8-8597-47e52511ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a 1073741824 Apr 08 17:45:04 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c237429-ae54-4029-aa0f-616e7707128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Volume volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c (4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c): created successfully Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c237429-ae54-4029-aa0f-616e7707128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (d0a9d72b-00af-47d2-9c47-362e2d2031c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c7dfd84a-f323-4dd3-bba5-d61ad5ebf848 tempest-CreateVolumesFromImageTest-1763512150 None] Created volume successfully. Apr 08 17:45:05 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a 1073741824" returned: 0 in 0.471s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:05 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a Apr 08 17:45:05 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:05 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371496907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5522981-cca0-428d-a3c0-c539bb04cb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Creating volume f5522981-cca0-428d-a3c0-c539bb04cb72 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:05 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af228d3-d36b-41b3-8cea-d26b33584460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03172dfd-ce9c-4089-9f52-c331e04fc22a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:05 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 1073741824 Apr 08 17:45:05 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5807344-6bcc-4523-92f5-58a04487e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:05 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Volume volume-03172dfd-ce9c-4089-9f52-c331e04fc22a (03172dfd-ce9c-4089-9f52-c331e04fc22a): created successfully Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5807344-6bcc-4523-92f5-58a04487e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (d03973bc-8767-409f-bf80-d543f3810614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-eb83fbd2-da82-4a9b-8863-3b48c12afde4 tempest-CreateVolumesFromImageTest-1763512150 None] Created volume successfully. Apr 08 17:45:06 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 1073741824" returned: 0 in 0.468s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:06 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 Apr 08 17:45:06 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:06 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72" returned: 0 in 0.408s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1808124761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d636980-b279-4376-8a37-ff3268201b3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75ffd665becf47c88bd7d6fafb8eff26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='dd03bdb9264c475f89186f708e20111f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Creating volume 2d636980-b279-4376-8a37-ff3268201b3a {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:06 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e963e269-066f-420f-b505-1ae8695ca70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5522981-cca0-428d-a3c0-c539bb04cb72', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:06 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a 1073741824 Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26f8e56-9cf8-4b35-b009-ce4ff348996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:06 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Volume volume-f5522981-cca0-428d-a3c0-c539bb04cb72 (f5522981-cca0-428d-a3c0-c539bb04cb72): created successfully Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26f8e56-9cf8-4b35-b009-ce4ff348996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (cbbdcf8c-13fa-407d-9ed1-c984b512b7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-75c994b5-ec1d-4f1e-944c-9521e6b3a6e2 tempest-CreateVolumesFromImageTest-1763512150 None] Created volume successfully. Apr 08 17:45:06 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a 1073741824" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:07 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a Apr 08 17:45:07 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:07 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1142286423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Creating volume 1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:07 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b946e1-760c-4dea-aede-8124dc9c3113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d636980-b279-4376-8a37-ff3268201b3a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69df0b95-c282-4243-b2b1-063171dd8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:07 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c 1073741824 Apr 08 17:45:07 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Volume volume-2d636980-b279-4376-8a37-ff3268201b3a (2d636980-b279-4376-8a37-ff3268201b3a): created successfully Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69df0b95-c282-4243-b2b1-063171dd8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Flow 'volume_create_manager' (3e9284ef-a317-4ec8-9b8f-8c98815d83e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a21cf074-d0e2-450c-94e1-35ae1ec546fc tempest-VolumesListTestJSON-1736134209 None] Created volume successfully. Apr 08 17:45:07 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c 1073741824" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:07 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c Apr 08 17:45:07 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:08 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" returned: 0 in 0.436s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.992s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034928951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20374f0-d8e0-45e2-be83-c1201076cf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a54b8c528341219d25f1446416c8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:04Z,use_quota=True,user_id='e0f51e11640f439bb2241e0922765c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Creating volume a20374f0-d8e0-45e2-be83-c1201076cf9d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:08 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360a62b6-f1ae-48ea-aa8c-fe9f153aa449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:08 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d 1073741824 Apr 08 17:45:08 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8577c897-4dd3-480b-9863-5cb66752a124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:08 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Volume volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c (1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c): created successfully Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8577c897-4dd3-480b-9863-5cb66752a124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (5b5f4a60-c376-4f4f-bb34-68ee8dacc0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:08 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f24176e9-cbfa-4167-ace4-4d2c9291417a tempest-CreateVolumesFromImageTest-1763512150 None] Created volume successfully. Apr 08 17:45:08 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d 1073741824" returned: 0 in 0.530s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:08 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d Apr 08 17:45:08 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:09 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d" returned: 0 in 0.443s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe21920-49e2-4053-9222-df2ff7b16416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20374f0-d8e0-45e2-be83-c1201076cf9d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec75592a-ddfc-4db9-aa8f-1593324e5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:09 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Volume volume-a20374f0-d8e0-45e2-be83-c1201076cf9d (a20374f0-d8e0-45e2-be83-c1201076cf9d): created successfully Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec75592a-ddfc-4db9-aa8f-1593324e5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Flow 'volume_create_manager' (1e378ff1-a906-4fbc-a61f-184a50703969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-15087cb3-b44d-4f18-9e91-76b62bdc62cd tempest-CreateVolumesFromImageTest-1763512150 None] Created volume successfully. Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-a20374f0-d8e0-45e2-be83-c1201076cf9d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-a20374f0-d8e0-45e2-be83-c1201076cf9d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-quobyte-a20374f0-d8e0-45e2-be83-c1201076cf9d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-a20374f0-d8e0-45e2-be83-c1201076cf9d" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9f4f0-238d-4d33-9499-70663f49c88e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:09 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d Apr 08 17:45:09 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-2d636980-b279-4376-8a37-ff3268201b3a-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-2d636980-b279-4376-8a37-ff3268201b3a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-quobyte-2d636980-b279-4376-8a37-ff3268201b3a" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-2d636980-b279-4376-8a37-ff3268201b3a" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2913c4c0-463a-4cf9-99d3-6a5ddc3ca7ff]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:10 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d" returned: 0 in 0.555s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:10 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d Apr 08 17:45:10 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:10 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a Apr 08 17:45:10 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:10 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a20374f0-d8e0-45e2-be83-c1201076cf9d" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-a20374f0-d8e0-45e2-be83-c1201076cf9d" released by "delete_volume" :: held 0.999s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Created reservations ['0022a08b-3a97-4931-96e1-acb5511df4c2', '9e3448d2-d37d-4776-9e4e-d31e4ec75891', '4c529ba8-3468-4a3a-b7fa-ae2f80beba04', '8a87e51b-e73d-4e18-8323-feb7af3ef813'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:10 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a" returned: 0 in 0.507s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:10 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a Apr 08 17:45:10 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:10 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:10 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:11 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-2d636980-b279-4376-8a37-ff3268201b3a" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-2d636980-b279-4376-8a37-ff3268201b3a" released by "delete_volume" :: held 0.956s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:11 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.405s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Deleted volume successfully. Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7388aa53-47a6-4134-a4ae-f9423bd19d4f tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-a20374f0-d8e0-45e2-be83-c1201076cf9d-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Created reservations ['0ec1df3e-3b46-4863-8979-68182c136a23', '651d9fa5-b937-480c-8d51-16aee096cc26', 'e9ca1cb1-10a8-45c2-819c-b04b0c676011', 'fdab34cb-70b6-48dc-ad68-d982ceca7cb5'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:11 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:11 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-179922ce-39b6-42c7-aec1-661358c1d828-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-179922ce-39b6-42c7-aec1-661358c1d828-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-quobyte-179922ce-39b6-42c7-aec1-661358c1d828" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-179922ce-39b6-42c7-aec1-661358c1d828" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ba6348-8184-4870-b406-9618bc5fcdcb]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:11 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 Apr 08 17:45:11 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:11 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Deleted volume successfully. Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-68aeeaa1-a5dd-4fbf-be7f-65db7e560cb9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-2d636980-b279-4376-8a37-ff3268201b3a-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-quobyte-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab4738f-ab80-43ae-9940-fec00e8fede8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:11 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828" returned: 0 in 0.486s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:12 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828 Apr 08 17:45:12 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c Apr 08 17:45:12 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-179922ce-39b6-42c7-aec1-661358c1d828" returned: 0 in 0.405s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-179922ce-39b6-42c7-aec1-661358c1d828" released by "delete_volume" :: held 0.914s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:12 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" returned: 0 in 0.470s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Created reservations ['cbda4f94-1f21-4e55-87ca-c6ea24038ef3', '1dc60b3d-66f2-4e6b-a960-051cfb93f976', '04672d41-7eb3-4172-bd90-09ff82003eb5', 'db6525d7-126c-491f-bf45-e9503f60be9d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:12 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c Apr 08 17:45:12 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:12 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:12 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-e87625f6-0600-4b49-9d6f-f490b6a161ea-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-e87625f6-0600-4b49-9d6f-f490b6a161ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "cinder-quobyte-e87625f6-0600-4b49-9d6f-f490b6a161ea" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-e87625f6-0600-4b49-9d6f-f490b6a161ea" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4372fee3-37e6-4611-9c69-87e9f4e411c5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:12 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea Apr 08 17:45:12 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" returned: 0 in 0.429s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c" released by "delete_volume" :: held 0.930s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Created reservations ['98a9f0d7-d455-44e5-b9ce-131d1e290a3b', '8eb038a4-2ce9-423f-abb7-6a28a1a5c806', 'a2df6cc5-28f7-4ad7-8b7c-25e870621b37', '953ecfa8-159c-4120-9009-2a7a96b30728'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:12 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:12 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:12 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:12 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Deleted volume successfully. Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-e0cae6a5-d8eb-4b16-bc92-1a34e576c6f9 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-179922ce-39b6-42c7-aec1-661358c1d828-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-f5522981-cca0-428d-a3c0-c539bb04cb72-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-f5522981-cca0-428d-a3c0-c539bb04cb72-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-quobyte-f5522981-cca0-428d-a3c0-c539bb04cb72" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-f5522981-cca0-428d-a3c0-c539bb04cb72" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7ef39-a0b4-4044-80fc-724478522fd9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:13 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 Apr 08 17:45:13 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:13 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:13 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea Apr 08 17:45:13 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:13 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.453s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Deleted volume successfully. Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-de7de22e-5620-41ee-81d1-e539f149f472 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-1f59e6f6-aeec-4fa7-bb4e-ea3e6405dc7c-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:13 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:13 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72 Apr 08 17:45:13 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:13 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e87625f6-0600-4b49-9d6f-f490b6a161ea" returned: 0 in 0.421s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-quobyte-e87625f6-0600-4b49-9d6f-f490b6a161ea" released by "delete_volume" :: held 0.943s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Created reservations ['3c1bd96d-9947-42c4-bc10-a38e1c1c164a', '200710f5-ff26-472b-a199-875952b5ef24', 'b5fc21c6-dc8e-40aa-9d6f-33873388d1a2', '2e733025-3cbe-4359-b809-a7c517f6bb44'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:13 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:13 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:14 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f5522981-cca0-428d-a3c0-c539bb04cb72" returned: 0 in 0.457s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-f5522981-cca0-428d-a3c0-c539bb04cb72" released by "delete_volume" :: held 0.979s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Created reservations ['39044ee0-d09b-463c-bc81-85771c7210cf', 'f693c373-1fb0-4a3d-966f-59df6fd4ff6d', 'd9214776-434d-4b35-8204-0ac3fff2eb8c', '2934022c-1712-43c7-a98b-c13f07f2025b'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:14 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Deleted volume successfully. Apr 08 17:45:14 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:14 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d76cd825-5e26-4a9e-a6fa-3333b9d453c8 tempest-VolumesListTestJSON-1736134209 None] Lock "cinder-e87625f6-0600-4b49-9d6f-f490b6a161ea-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-03172dfd-ce9c-4089-9f52-c331e04fc22a-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-03172dfd-ce9c-4089-9f52-c331e04fc22a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-quobyte-03172dfd-ce9c-4089-9f52-c331e04fc22a" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-03172dfd-ce9c-4089-9f52-c331e04fc22a" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1881cbd0-87e8-4d9b-8a5e-6db7c5245185]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:14 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a Apr 08 17:45:14 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:14 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:14 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Deleted volume successfully. Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d5d15d50-da7d-48bc-b2ad-da5c6f06728b tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-f5522981-cca0-428d-a3c0-c539bb04cb72-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:14 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a" returned: 0 in 0.534s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:14 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:14 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a Apr 08 17:45:14 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:15 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-03172dfd-ce9c-4089-9f52-c331e04fc22a" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-03172dfd-ce9c-4089-9f52-c331e04fc22a" released by "delete_volume" :: held 0.983s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Created reservations ['0d588f72-92ae-4eaa-ace7-07f77213bd5c', '064bf254-2188-4df9-853e-a8c0c9fa15c0', '9afbf646-b5b7-411e-ae05-57013011b71e', 'b5e18479-f0f3-4a9e-9f9c-892e75c264c4'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:15 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:15 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Flow 'volume_create_manager' (015fe882-72f8-43c4-b8a1-e32d3330a00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31364986-5341-4760-8b21-2eed58fd13b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31364986-5341-4760-8b21-2eed58fd13b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-756333388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f728a5-6d39-4da1-ab71-07ee7ae3aecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf99e60dd67467ebb87284188129f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:15Z,use_quota=True,user_id='efc58b8416c44ed1be5a20e70ecc8208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a60367-2137-47ee-b059-0eddf01a3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a60367-2137-47ee-b059-0eddf01a3216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bf5973-4608-4d8b-af8b-2c1fe6c3d084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bf5973-4608-4d8b-af8b-2c1fe6c3d084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f728a5-6d39-4da1-ab71-07ee7ae3aecc', 'volume_name': 'volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf2f8fe-03a6-4fb5-93d4-144c9edc0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf2f8fe-03a6-4fb5-93d4-144c9edc0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05b700d-66e4-478f-8f7c-70e71fd3de0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:15 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc', 'volume_size': 1} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-756333388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f728a5-6d39-4da1-ab71-07ee7ae3aecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf99e60dd67467ebb87284188129f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:15Z,use_quota=True,user_id='efc58b8416c44ed1be5a20e70ecc8208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Creating volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:15 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "cinder-quobyte-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:15 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc 1073741824 Apr 08 17:45:15 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7003920-737b-4465-a3b1-412a8c531333]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:15 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c Apr 08 17:45:15 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:15 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:15 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Deleted volume successfully. Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-124455a1-99cc-4b55-8fa7-e501dc592954 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-03172dfd-ce9c-4089-9f52-c331e04fc22a-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:15 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc 1073741824" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:16 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc Apr 08 17:45:16 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:16 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" returned: 0 in 0.490s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:16 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c Apr 08 17:45:16 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:16 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" returned: 0 in 0.414s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05b700d-66e4-478f-8f7c-70e71fd3de0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52b6302-cd1b-4e41-8e49-3e2ab47ab5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:16 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Volume volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc (12f728a5-6d39-4da1-ab71-07ee7ae3aecc): created successfully Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52b6302-cd1b-4e41-8e49-3e2ab47ab5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:16 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Flow 'volume_create_manager' (015fe882-72f8-43c4-b8a1-e32d3330a00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-quobyte-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c" released by "delete_volume" :: held 0.939s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f7816929-34a5-46f7-a032-a74a24396d00 tempest-VolumesSnapshotListTestJSON-1775243960 None] Created volume successfully. Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Created reservations ['c02e29ba-6aa5-44eb-9b2f-51192d14ac66', '062c2ee1-2bdf-41af-8e51-72182bf132b8', 'e506f766-57dc-4abf-9dee-561e42018943', 'd6796425-d39a-46ac-b8d5-9b807445b51d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:16 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:16 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:16 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Deleted volume successfully. Apr 08 17:45:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ac985de5-dd14-4aab-9cc8-4ef0ae6b49c2 tempest-CreateVolumesFromImageTest-1763512150 None] Lock "cinder-4fbcc356-9f9a-4b57-8c25-bfb03ac60c4c-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Creating offline snapshot bdac8afa-ab8e-4589-b9ad-16c397880b76 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4dc45c-de37-4ebe-9b81-41791ff46c7e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:17 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc Apr 08 17:45:17 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:18 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:18 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 1G Apr 08 17:45:18 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:18 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 1G" returned: 0 in 0.550s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:18 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:18 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:19 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:19 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 is being set with open permissions: ugo+rw Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:19 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:19 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Flow 'volume_create_manager' (4bccbca7-33cd-40f9-b213-c89299988a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a5149f-6b28-4f13-8bd0-e381b49d5231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a5149f-6b28-4f13-8bd0-e381b49d5231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05d5c30-1e65-4959-aaef-5f3d0274a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0e80bfe13d4132b9d296a7a8d5f7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:19Z,use_quota=True,user_id='f61a392e5b0545808db0444e9568ec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9172b0f5-b2ab-4590-b04b-4f73f88548b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9172b0f5-b2ab-4590-b04b-4f73f88548b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d597c679-ec84-48f8-9de1-cca3cf80373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d597c679-ec84-48f8-9de1-cca3cf80373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd05d5c30-1e65-4959-aaef-5f3d0274a95d', 'volume_name': 'volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f9ccc-cf5d-41be-8233-628994552ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f9ccc-cf5d-41be-8233-628994552ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6713b-8c81-4294-828c-373db8cdb55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:19 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Volume d05d5c30-1e65-4959-aaef-5f3d0274a95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d', 'volume_size': 1} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:19 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.397s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:19 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info Apr 08 17:45:19 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:20 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info" returned: 0 in 0.417s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:20 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info is being set with open permissions: ugo+rw Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:20 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info Apr 08 17:45:20 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:20 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.info" returned: 0 in 0.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05d5c30-1e65-4959-aaef-5f3d0274a95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0e80bfe13d4132b9d296a7a8d5f7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:19Z,use_quota=True,user_id='f61a392e5b0545808db0444e9568ec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Creating volume d05d5c30-1e65-4959-aaef-5f3d0274a95d {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:20 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:20 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d 1073741824 Apr 08 17:45:20 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-32e23152-66cb-4bdc-954c-23d8fa73a14c tempest-VolumesSnapshotListTestJSON-1775243960 None] Create snapshot completed successfully Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:20 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d 1073741824" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:21 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d Apr 08 17:45:21 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:21 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d" returned: 0 in 0.428s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.599s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6713b-8c81-4294-828c-373db8cdb55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e17cdb-267f-4b77-92d7-aaab977649b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:21 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Volume volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d (d05d5c30-1e65-4959-aaef-5f3d0274a95d): created successfully Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e17cdb-267f-4b77-92d7-aaab977649b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Flow 'volume_create_manager' (4bccbca7-33cd-40f9-b213-c89299988a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Creating offline snapshot 84813334-81c1-4c8b-8fec-972ae0cb3353 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:21 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f8b45df9-972e-47fb-b740-a670ff803931 tempest-CinderUnicodeTest-2074078860 None] Created volume successfully. Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f7583e-0ef7-4d74-a8a6-4a3fb372d45d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:21 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:21 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:21 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:21 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 1G Apr 08 17:45:21 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:22 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 1G" returned: 0 in 0.510s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:22 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:22 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Flow 'volume_create_manager' (44f9d5c8-b4e6-4db3-8937-fba9d6cf3b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e92260-e26c-457a-acb2-0108fd0e885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e92260-e26c-457a-acb2-0108fd0e885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1553844331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034d221-5ddd-4bb8-a652-9c1b4eb19862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0e80bfe13d4132b9d296a7a8d5f7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:23Z,use_quota=True,user_id='f61a392e5b0545808db0444e9568ec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41571466-b9b3-49df-9f30-b97c8867fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41571466-b9b3-49df-9f30-b97c8867fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949a9c6b-116f-40e6-a3e3-edb5ecc5ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949a9c6b-116f-40e6-a3e3-edb5ecc5ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4034d221-5ddd-4bb8-a652-9c1b4eb19862', 'volume_name': 'volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d64a90-8110-4639-8c2e-f21df02ab50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d64a90-8110-4639-8c2e-f21df02ab50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa2ac1c-ae45-4a54-bee6-cc65f3484792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:22 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Volume 4034d221-5ddd-4bb8-a652-9c1b4eb19862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862', 'volume_size': 1} Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:22 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.458s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:22 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 is being set with open permissions: ugo+rw Apr 08 17:45:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:22 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:22 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:23 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.403s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1553844331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4034d221-5ddd-4bb8-a652-9c1b4eb19862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0e80bfe13d4132b9d296a7a8d5f7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:23Z,use_quota=True,user_id='f61a392e5b0545808db0444e9568ec8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Creating volume 4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:23 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:23 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 1073741824 Apr 08 17:45:23 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:23 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3794ecdf-5393-4514-a356-dfc81031c41c tempest-VolumesSnapshotListTestJSON-1775243960 None] Create snapshot completed successfully Apr 08 17:45:23 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 1073741824" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:23 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 Apr 08 17:45:23 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:24 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862" returned: 0 in 0.434s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Creating offline snapshot b125a823-19cc-4e3a-ba1e-97345f3a4ec5 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa2ac1c-ae45-4a54-bee6-cc65f3484792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af790b5-a05c-4316-82e5-c1027ff08078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29aade-f84f-475e-9514-f9ca86d2784e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:24 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Volume volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 (4034d221-5ddd-4bb8-a652-9c1b4eb19862): created successfully Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af790b5-a05c-4316-82e5-c1027ff08078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Flow 'volume_create_manager' (44f9d5c8-b4e6-4db3-8937-fba9d6cf3b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a35d76c4-dc75-403a-ad7d-7856aec1bb50 tempest-CinderUnicodeTest-2074078860 None] Created volume successfully. Apr 08 17:45:24 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:24 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:24 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:24 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 1G Apr 08 17:45:24 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:25 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 1G" returned: 0 in 0.522s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:25 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 Apr 08 17:45:25 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:25 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:25 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 is being set with open permissions: ugo+rw Apr 08 17:45:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:25 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 Apr 08 17:45:25 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:26 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5" returned: 0 in 0.418s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.320s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Creating offline snapshot e3523b22-91e7-48db-8aaf-4d428a077697 of volume 4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:26 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0a67f1d4-a34a-4eba-8d78-7ea10f174dfe tempest-VolumesSnapshotListTestJSON-1775243960 None] Create snapshot completed successfully Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe5750-cd5f-4aac-8040-bf9dbe30f14d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:26 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 Apr 08 17:45:26 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:26 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:26 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 1G Apr 08 17:45:26 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:27 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 1G" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:27 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 Apr 08 17:45:27 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:27 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697" returned: 0 in 0.506s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:27 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 is being set with open permissions: ugo+rw Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-b125a823-19cc-4e3a-ba1e-97345f3a4ec5-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:27 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 Apr 08 17:45:27 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-b125a823-19cc-4e3a-ba1e-97345f3a4ec5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-b125a823-19cc-4e3a-ba1e-97345f3a4ec5" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-b125a823-19cc-4e3a-ba1e-97345f3a4ec5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Deleting offline snapshot b125a823-19cc-4e3a-ba1e-97345f3a4ec5 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] snapshot_file for this snap is: volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9225d-63b0-4f9f-879d-61092ef594a5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:27 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 Apr 08 17:45:27 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:28 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:28 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info Apr 08 17:45:28 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:28 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5" returned: 0 in 0.488s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff38be8-821b-4f16-be4c-f9e8f414e242]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:28 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:28 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:28 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info" returned: 0 in 0.420s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:28 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info is being set with open permissions: ugo+rw Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:28 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info Apr 08 17:45:28 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:28 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.465s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:28 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 Apr 08 17:45:28 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:29 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.info" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-90619992-bcc9-43f1-b1ef-7a105aaf3e3b tempest-CinderUnicodeTest-2074078860 None] Create snapshot completed successfully Apr 08 17:45:29 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:29 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5 Apr 08 17:45:29 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:29 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.b125a823-19cc-4e3a-ba1e-97345f3a4ec5" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-b125a823-19cc-4e3a-ba1e-97345f3a4ec5" released by "_delete_snapshot" :: held 1.905s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" released by "delete_snapshot" :: held 1.917s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=157,cinder:SELECT=108,cinder:INSERT=24,cinder:DELETE=18 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Created reservations ['92005530-c96f-469a-8564-01cfad7c3b5c', 'b461b411-5e4a-4363-97c2-58c436289363', '05fb0bf3-0ecc-4682-9527-937093ed5498', 'fe306145-509d-4787-acb8-5efcaf0ad906'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Delete snapshot completed successfully. Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-b5e9e832-e26e-4b36-9e3a-bd0f0ccffb06 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-b125a823-19cc-4e3a-ba1e-97345f3a4ec5-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-84813334-81c1-4c8b-8fec-972ae0cb3353-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-84813334-81c1-4c8b-8fec-972ae0cb3353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-84813334-81c1-4c8b-8fec-972ae0cb3353" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-84813334-81c1-4c8b-8fec-972ae0cb3353" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Deleting offline snapshot 84813334-81c1-4c8b-8fec-972ae0cb3353 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] snapshot_file for this snap is: volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9a157-e5c8-4200-90d9-25fab9fc8ccc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:29 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:29 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-e3523b22-91e7-48db-8aaf-4d428a077697-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-e3523b22-91e7-48db-8aaf-4d428a077697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-quobyte-e3523b22-91e7-48db-8aaf-4d428a077697" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-e3523b22-91e7-48db-8aaf-4d428a077697" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Deleting offline snapshot e3523b22-91e7-48db-8aaf-4d428a077697 of volume 4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] snapshot_file for this snap is: volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[84670c0e-9b98-4401-9c42-981175474e7a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:30 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 Apr 08 17:45:30 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:30 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bda21-e1a8-4740-a298-acb81bb267d2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:30 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:30 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:30 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba72173-bbed-4225-bbc8-7ae54143a1db]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:30 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 Apr 08 17:45:30 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:30 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:30 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:30 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:31 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862" returned: 0 in 0.476s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:31 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 Apr 08 17:45:31 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:31 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.468s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:31 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353 Apr 08 17:45:31 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:31 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:31 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697 Apr 08 17:45:31 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:31 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.84813334-81c1-4c8b-8fec-972ae0cb3353" returned: 0 in 0.431s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-84813334-81c1-4c8b-8fec-972ae0cb3353" released by "_delete_snapshot" :: held 1.915s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" released by "delete_snapshot" :: held 1.932s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Created reservations ['bc9ec398-6b30-4559-8c0d-1ad48a9bd83c', '842525c9-1eb7-48da-ae4a-5c6e614fe7c9', '4d103122-16c1-46a7-861c-f71b3812ec3f', 'ff00516e-91b6-4486-90db-6649fd19e96d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Delete snapshot completed successfully. Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-23cb0315-3eef-4c7b-be2b-7fa039162fa4 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-84813334-81c1-4c8b-8fec-972ae0cb3353-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-bdac8afa-ab8e-4589-b9ad-16c397880b76-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-bdac8afa-ab8e-4589-b9ad-16c397880b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-bdac8afa-ab8e-4589-b9ad-16c397880b76" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-bdac8afa-ab8e-4589-b9ad-16c397880b76" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Deleting offline snapshot bdac8afa-ab8e-4589-b9ad-16c397880b76 of volume 12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] snapshot_file for this snap is: volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b00b42-c7f0-48ca-97d9-21f5369040f5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:32 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862.e3523b22-91e7-48db-8aaf-4d428a077697" returned: 0 in 0.444s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-e3523b22-91e7-48db-8aaf-4d428a077697" released by "_delete_snapshot" :: held 1.938s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" released by "delete_snapshot" :: held 1.948s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:32 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:32 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Created reservations ['aa9ca978-9004-45ef-a67f-63d55bc49b88', '080ca825-4c78-435b-8930-fb88312aeae6', 'efecdd27-a21b-4d6b-a249-462c4109d0ac', '7129298e-f213-499d-9e63-4d6cae4a28a7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:32 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Delete snapshot completed successfully. Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-ea414278-72ae-487f-88fd-2bee10044bd6 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-e3523b22-91e7-48db-8aaf-4d428a077697-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-4034d221-5ddd-4bb8-a652-9c1b4eb19862-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-4034d221-5ddd-4bb8-a652-9c1b4eb19862-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607127a-1fcd-4db7-af17-1604167d7d78]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:32 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 Apr 08 17:45:32 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:32 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c23d9d-c108-461e-ba25-629a79e641bd]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:32 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc Apr 08 17:45:32 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:32 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862" returned: 0 in 0.473s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:32 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862 Apr 08 17:45:32 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:32 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" returned: 0 in 0.458s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:32 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:33 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:33 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4034d221-5ddd-4bb8-a652-9c1b4eb19862" returned: 0 in 0.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-4034d221-5ddd-4bb8-a652-9c1b4eb19862" released by "delete_volume" :: held 0.919s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Created reservations ['c72dbf98-b3f1-4979-b3e8-e4219cf0a1bc', 'c8d32895-357b-490e-bd71-c74420a549ae', 'c66701a7-bfdb-4935-a0f1-75b50c084a6f', 'fc66967a-cf78-433d-8ca5-a2ae6c176a5b'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:33 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:33 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-d05d5c30-1e65-4959-aaef-5f3d0274a95d-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-d05d5c30-1e65-4959-aaef-5f3d0274a95d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "cinder-quobyte-d05d5c30-1e65-4959-aaef-5f3d0274a95d" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-d05d5c30-1e65-4959-aaef-5f3d0274a95d" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[28773825-0121-4f41-a5c0-2bf68f045866]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:33 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d Apr 08 17:45:33 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:33 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.509s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:33 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76 Apr 08 17:45:33 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:33 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Deleted volume successfully. Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-56dad4d8-8c78-45a9-a27b-c17b4bda349d tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-4034d221-5ddd-4bb8-a652-9c1b4eb19862-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:33 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d" returned: 0 in 0.502s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:33 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d Apr 08 17:45:33 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:33 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc.bdac8afa-ab8e-4589-b9ad-16c397880b76" returned: 0 in 0.422s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-bdac8afa-ab8e-4589-b9ad-16c397880b76" released by "_delete_snapshot" :: held 1.928s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" released by "delete_snapshot" :: held 1.940s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:33 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Created reservations ['6985b32d-6a8c-4af6-84bc-4d2fa710e152', '66863b2e-28ca-4ae2-9a80-c6aa0b3048e0', 'de8521e4-e383-414f-a5d9-d2d71fc20825', '6bdf40ae-9f6c-4030-bc0b-e508dfc4f0b7'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Delete snapshot completed successfully. Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-377c1f08-4b9e-426f-b368-12ef1e2eddee tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-bdac8afa-ab8e-4589-b9ad-16c397880b76-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-12f728a5-6d39-4da1-ab71-07ee7ae3aecc-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-12f728a5-6d39-4da1-ab71-07ee7ae3aecc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ed13b-05b0-455a-8794-50b38d98af65]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:34 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc Apr 08 17:45:34 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:34 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-d05d5c30-1e65-4959-aaef-5f3d0274a95d" returned: 0 in 0.456s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-quobyte-d05d5c30-1e65-4959-aaef-5f3d0274a95d" released by "delete_volume" :: held 0.981s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Created reservations ['235b76eb-3708-4037-ad7f-8c9d6535d241', '425622e7-bcc1-4263-971f-fb542f8b9c27', '6cafc3f9-6222-474a-931a-daaad0d5122a', 'a72173e0-e926-444b-8085-29d532611a49'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:34 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:34 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:34 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:34 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc Apr 08 17:45:34 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:34 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.406s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Deleted volume successfully. Apr 08 17:45:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-01100658-b5c7-4ab5-8e12-5be1b0fbf038 tempest-CinderUnicodeTest-2074078860 None] Lock "cinder-d05d5c30-1e65-4959-aaef-5f3d0274a95d-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:35 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" returned: 0 in 0.402s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-quobyte-12f728a5-6d39-4da1-ab71-07ee7ae3aecc" released by "delete_volume" :: held 0.911s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=155,cinder:UPDATE=193,cinder:DELETE=14,cinder:INSERT=59 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Created reservations ['50dd947d-1cd2-4b1b-90b8-49d8f0d5561b', 'cf4f8aff-3b8e-49ff-9011-fa2df53c863c', '82119462-d821-460b-9861-5a0d1446a730', 'de1c1c4a-a050-4517-8e55-a017061721ae'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:35 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:35 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:35 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.468s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Deleted volume successfully. Apr 08 17:45:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c9728ad3-2609-4813-9777-c87e07560139 tempest-VolumesSnapshotListTestJSON-1775243960 None] Lock "cinder-12f728a5-6d39-4da1-ab71-07ee7ae3aecc-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (45f0cfb1-b7ec-4c94-ac9d-52a55c15ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437cc20f-509b-4ab4-8c7d-9b4bdabb2916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437cc20f-509b-4ab4-8c7d-9b4bdabb2916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-800399707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbc1796-93ba-440b-96f2-b8f78dba3cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41078ed0-8162-48e9-aa2e-4a9181b6ff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41078ed0-8162-48e9-aa2e-4a9181b6ff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b4221-e66e-4d64-adfb-2a187394c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b4221-e66e-4d64-adfb-2a187394c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbc1796-93ba-440b-96f2-b8f78dba3cdc', 'volume_name': 'volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07d209-0519-46c1-8946-89c28bd25f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07d209-0519-46c1-8946-89c28bd25f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1667bd44-93dd-4c71-8e1a-74d84f3bd16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Volume 9bbc1796-93ba-440b-96f2-b8f78dba3cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc', 'volume_size': 1} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-800399707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbc1796-93ba-440b-96f2-b8f78dba3cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Creating volume 9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:42 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:42 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc 1073741824 Apr 08 17:45:42 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (66613f63-ad3d-405e-b921-95dc00b2b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd1c978-1ce5-4b57-9f85-3611354866b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd1c978-1ce5-4b57-9f85-3611354866b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565481211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44c1b33-8f5e-425a-8d3c-8e31b84b9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e44e7e-c43a-4e66-942e-ccc324084299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e44e7e-c43a-4e66-942e-ccc324084299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f8ad48-7f73-4e92-a4ba-81405ef617ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f8ad48-7f73-4e92-a4ba-81405ef617ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44c1b33-8f5e-425a-8d3c-8e31b84b9126', 'volume_name': 'volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbc8b40-a62a-41dc-94a1-b7f0035c3465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbc8b40-a62a-41dc-94a1-b7f0035c3465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e77ceb7-b6f9-4644-bd89-d97c97f5a413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume c44c1b33-8f5e-425a-8d3c-8e31b84b9126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126', 'volume_size': 1} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (66e025c4-3f47-4a82-aa15-38b1c2980adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785c298e-7b42-4b1b-8fe9-29901e56d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785c298e-7b42-4b1b-8fe9-29901e56d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392842856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cc75af-d7c6-45a0-91a7-6098dbf72496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:42 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aade10-705e-4d61-98a0-53c56ba76096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94aade10-705e-4d61-98a0-53c56ba76096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a92c3-4074-4a62-b9ff-d58a7af8fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a92c3-4074-4a62-b9ff-d58a7af8fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cc75af-d7c6-45a0-91a7-6098dbf72496', 'volume_name': 'volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aa40f8-5d4a-455c-9365-4fb32c643f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aa40f8-5d4a-455c-9365-4fb32c643f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2c0f7a-a8bd-430a-ab90-828450108b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Volume c8cc75af-d7c6-45a0-91a7-6098dbf72496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496', 'volume_size': 1} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (3bfc9103-e667-45b7-8a59-8e65bc9f8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdfe695-a56d-4e7b-b3ce-f3f1500e69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdfe695-a56d-4e7b-b3ce-f3f1500e69de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520650683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bd0cbe-2453-4875-8d12-854127b78eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3ff1f3-70a1-4cab-a8f7-f3a9af39bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3ff1f3-70a1-4cab-a8f7-f3a9af39bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9245f-f031-40dc-8c18-286af935e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b9245f-f031-40dc-8c18-286af935e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bd0cbe-2453-4875-8d12-854127b78eb5', 'volume_name': 'volume-37bd0cbe-2453-4875-8d12-854127b78eb5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33148965-4924-44d7-b2c8-d8d3df16a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33148965-4924-44d7-b2c8-d8d3df16a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794c05c-b033-41b2-b54e-d82d869b03a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Volume 37bd0cbe-2453-4875-8d12-854127b78eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bd0cbe-2453-4875-8d12-854127b78eb5', 'volume_size': 1} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:43 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc 1073741824" returned: 0 in 0.624s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (2e3d602d-67f4-44a1-ba2e-86aac858b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe0a4d9-5793-46a2-a557-dad845b5c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe0a4d9-5793-46a2-a557-dad845b5c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249568495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24497e0c-c7a9-45c6-b8c9-da0e96539808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d5ce3-dae0-475c-bbe0-fdd74d9d2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d5ce3-dae0-475c-bbe0-fdd74d9d2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6c10db-44fa-4b0e-a9f0-cc2f18fca3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6c10db-44fa-4b0e-a9f0-cc2f18fca3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24497e0c-c7a9-45c6-b8c9-da0e96539808', 'volume_name': 'volume-24497e0c-c7a9-45c6-b8c9-da0e96539808', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcae1c0b-562f-4cc5-9273-601ae81e89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcae1c0b-562f-4cc5-9273-601ae81e89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8279160-5c75-4918-b97a-0599c5f56665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Volume 24497e0c-c7a9-45c6-b8c9-da0e96539808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24497e0c-c7a9-45c6-b8c9-da0e96539808', 'volume_size': 1} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:43 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:45:43 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (132db8a1-28a4-4f60-9c4c-ec69a95651de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc448b-5275-4b5e-84ce-f2e9ff115d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc448b-5275-4b5e-84ce-f2e9ff115d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947307941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023cbaad-60e2-4750-b7d0-728777eaa201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:44Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d242c115-dc86-4ce1-81d6-43d38ef3a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d242c115-dc86-4ce1-81d6-43d38ef3a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8e81c7-2832-4d6d-a40b-b25be43cde1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8e81c7-2832-4d6d-a40b-b25be43cde1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023cbaad-60e2-4750-b7d0-728777eaa201', 'volume_name': 'volume-023cbaad-60e2-4750-b7d0-728777eaa201', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67abd5f9-a52c-4542-88c1-e7cb4d32701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67abd5f9-a52c-4542-88c1-e7cb4d32701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a126b8-bcbb-451a-b12b-060f8aff79c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Volume 023cbaad-60e2-4750-b7d0-728777eaa201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023cbaad-60e2-4750-b7d0-728777eaa201', 'volume_size': 1} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (dc7de903-ec37-4ece-bae5-3932c8e67413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5991ce94-c117-4de1-ade3-4ee357667b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5991ce94-c117-4de1-ade3-4ee357667b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582220525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a710e91-1aa0-409e-93d4-87a1a8bf797b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:44Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76b2e57-ece3-41f5-9628-3b36d5db4ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76b2e57-ece3-41f5-9628-3b36d5db4ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdc46e5-4098-469c-96bf-f47657c77630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdc46e5-4098-469c-96bf-f47657c77630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a710e91-1aa0-409e-93d4-87a1a8bf797b', 'volume_name': 'volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9554f95a-0884-4831-b876-650174d317a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9554f95a-0884-4831-b876-650174d317a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e344bf61-8e5d-4370-913f-d85904c4ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:43 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Volume 4a710e91-1aa0-409e-93d4-87a1a8bf797b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b', 'volume_size': 1} Apr 08 17:45:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:44 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565481211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44c1b33-8f5e-425a-8d3c-8e31b84b9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:44 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1667bd44-93dd-4c71-8e1a-74d84f3bd16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d92100-e620-4cc5-bea6-924a68781c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:44 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 1073741824 Apr 08 17:45:44 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:44 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Volume volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc (9bbc1796-93ba-440b-96f2-b8f78dba3cdc): created successfully Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d92100-e620-4cc5-bea6-924a68781c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (45f0cfb1-b7ec-4c94-ac9d-52a55c15ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:44 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2640b768-d75d-46ef-8c67-c451a8a98292 tempest-VolumeDependencyTests-659622227 None] Created volume successfully. Apr 08 17:45:44 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 1073741824" returned: 0 in 0.514s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:44 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 Apr 08 17:45:44 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:45 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392842856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cc75af-d7c6-45a0-91a7-6098dbf72496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Creating volume c8cc75af-d7c6-45a0-91a7-6098dbf72496 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:45 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e77ceb7-b6f9-4644-bd89-d97c97f5a413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:45 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 1073741824 Apr 08 17:45:45 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a03460-efe1-44e0-bd73-265e163ac4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:45 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 (c44c1b33-8f5e-425a-8d3c-8e31b84b9126): created successfully Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a03460-efe1-44e0-bd73-265e163ac4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (66613f63-ad3d-405e-b921-95dc00b2b8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f8a0ae81-3279-4d3a-973c-5877dd98a854 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:45:45 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 1073741824" returned: 0 in 0.531s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:45 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 Apr 08 17:45:45 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:46 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496" returned: 0 in 0.533s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520650683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bd0cbe-2453-4875-8d12-854127b78eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Creating volume 37bd0cbe-2453-4875-8d12-854127b78eb5 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:46 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2c0f7a-a8bd-430a-ab90-828450108b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0abc9a-108a-4b95-949a-d23601471347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:46 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 1073741824 Apr 08 17:45:46 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:46 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Volume volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 (c8cc75af-d7c6-45a0-91a7-6098dbf72496): created successfully Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0abc9a-108a-4b95-949a-d23601471347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (66e025c4-3f47-4a82-aa15-38b1c2980adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:46 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e16261f7-8058-41a5-8ac8-fbe51c0f1bc4 tempest-CreateVolumesFromImageTest-786338696 None] Created volume successfully. Apr 08 17:45:46 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 1073741824" returned: 0 in 0.533s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:46 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 Apr 08 17:45:46 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:47 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5" returned: 0 in 0.553s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249568495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24497e0c-c7a9-45c6-b8c9-da0e96539808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:43Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Creating volume 24497e0c-c7a9-45c6-b8c9-da0e96539808 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:47 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794c05c-b033-41b2-b54e-d82d869b03a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bd0cbe-2453-4875-8d12-854127b78eb5', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd904f3-0195-4ee9-b95f-6d378a1e5651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:47 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 1073741824 Apr 08 17:45:47 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:47 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Volume volume-37bd0cbe-2453-4875-8d12-854127b78eb5 (37bd0cbe-2453-4875-8d12-854127b78eb5): created successfully Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd904f3-0195-4ee9-b95f-6d378a1e5651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (3bfc9103-e667-45b7-8a59-8e65bc9f8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:47 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9f91d0d6-4a0b-43e1-ac73-a016733118b0 tempest-CreateVolumesFromImageTest-786338696 None] Created volume successfully. Apr 08 17:45:47 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 1073741824" returned: 0 in 0.580s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:47 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 Apr 08 17:45:47 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:48 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808" returned: 0 in 0.492s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.613s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947307941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023cbaad-60e2-4750-b7d0-728777eaa201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:44Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Creating volume 023cbaad-60e2-4750-b7d0-728777eaa201 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:48 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8279160-5c75-4918-b97a-0599c5f56665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24497e0c-c7a9-45c6-b8c9-da0e96539808', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:48 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 1073741824 Apr 08 17:45:48 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79081dce-9bfb-48fd-8e40-d79762a1a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:48 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Volume volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 (24497e0c-c7a9-45c6-b8c9-da0e96539808): created successfully Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79081dce-9bfb-48fd-8e40-d79762a1a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:48 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (2e3d602d-67f4-44a1-ba2e-86aac858b126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c45dcb04-82f6-414b-a7fa-1dd310f83ec2 tempest-CreateVolumesFromImageTest-786338696 None] Created volume successfully. Apr 08 17:45:49 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 1073741824" returned: 0 in 0.601s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:49 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 Apr 08 17:45:49 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:49 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201" returned: 0 in 0.501s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.568s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582220525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a710e91-1aa0-409e-93d4-87a1a8bf797b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f372be2176a4a57bf31b6ee13a0330c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:44Z,use_quota=True,user_id='f5a11e191d1946a6b8e91934cad215c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Creating volume 4a710e91-1aa0-409e-93d4-87a1a8bf797b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:49 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a126b8-bcbb-451a-b12b-060f8aff79c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023cbaad-60e2-4750-b7d0-728777eaa201', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a5c500-854b-45cd-a697-eff363e959b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:49 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b 1073741824 Apr 08 17:45:49 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:49 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Volume volume-023cbaad-60e2-4750-b7d0-728777eaa201 (023cbaad-60e2-4750-b7d0-728777eaa201): created successfully Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a5c500-854b-45cd-a697-eff363e959b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:49 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (132db8a1-28a4-4f60-9c4c-ec69a95651de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:49 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a9ed0ff0-ecd3-4bd3-bff5-442fa228d936 tempest-CreateVolumesFromImageTest-786338696 None] Created volume successfully. Apr 08 17:45:50 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b 1073741824" returned: 0 in 0.539s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:50 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b Apr 08 17:45:50 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:50 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.621s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Creating offline snapshot 4840375f-f217-44e5-97cd-b2468c2ebc1b of volume 9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e344bf61-8e5d-4370-913f-d85904c4ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9681e64-0954-4d2d-a8d4-03bb2334b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[22876310-76f3-4a24-a8d5-939a59fed0af]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:50 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Volume volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b (4a710e91-1aa0-409e-93d4-87a1a8bf797b): created successfully Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9681e64-0954-4d2d-a8d4-03bb2334b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:50 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Flow 'volume_create_manager' (dc7de903-ec37-4ece-bae5-3932c8e67413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:50 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-04520a53-e64e-4b72-ab30-f3e0484105b1 tempest-CreateVolumesFromImageTest-786338696 None] Created volume successfully. Apr 08 17:45:50 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:45:50 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:51 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:51 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b 1G Apr 08 17:45:51 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-4a710e91-1aa0-409e-93d4-87a1a8bf797b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-4a710e91-1aa0-409e-93d4-87a1a8bf797b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-quobyte-4a710e91-1aa0-409e-93d4-87a1a8bf797b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-4a710e91-1aa0-409e-93d4-87a1a8bf797b" acquired by "delete_volume" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44df1ec-68e6-45f1-b449-13a7a0776ca1]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:51 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b 1G" returned: 0 in 0.582s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:51 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:51 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:45:51 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:51 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b Apr 08 17:45:51 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:52 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b" returned: 0 in 0.522s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:52 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b Apr 08 17:45:52 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:52 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.550s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:52 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b is being set with open permissions: ugo+rw Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:52 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:45:52 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:52 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4a710e91-1aa0-409e-93d4-87a1a8bf797b" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-4a710e91-1aa0-409e-93d4-87a1a8bf797b" released by "delete_volume" :: held 1.031s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Created reservations ['f4b3dd3a-e2b1-4986-8e91-0bbb0b23e9ba', 'f2d29797-f3fc-454f-b756-3e6f1de42de4', '06df87cb-0969-46bd-81c6-a808d1aba1ad', 'd3950fef-97bf-4a4c-803a-0c7245d54793'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:52 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:52 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:52 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:52 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:52 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info Apr 08 17:45:52 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:53 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Deleted volume successfully. Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4fee4e75-a72b-48a4-87f3-f17588a728a8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-4a710e91-1aa0-409e-93d4-87a1a8bf797b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:53 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info" returned: 0 in 0.526s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:53 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info is being set with open permissions: ugo+rw Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:53 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info Apr 08 17:45:53 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:53 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.info" returned: 0 in 0.458s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.580s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-023cbaad-60e2-4750-b7d0-728777eaa201-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating offline snapshot 718541ba-e7bd-4a52-a29b-31a88068b6f0 of volume c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[58369ef4-926c-46d0-b317-8379bbcf1cb3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-023cbaad-60e2-4750-b7d0-728777eaa201-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:53 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d8395d2b-9d39-407e-afcc-c7db4473f92e tempest-VolumeDependencyTests-659622227 None] Create snapshot completed successfully Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-quobyte-023cbaad-60e2-4750-b7d0-728777eaa201" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-023cbaad-60e2-4750-b7d0-728777eaa201" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d66ff06-3169-4add-a19a-128015db79b6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:53 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:53 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 Apr 08 17:45:53 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:53 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 Apr 08 17:45:53 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:54 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" returned: 0 in 0.569s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:54 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 1G Apr 08 17:45:54 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:54 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201" returned: 0 in 0.579s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:54 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201 Apr 08 17:45:54 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (66282945-1c39-40d1-a901-1b8a5e3cb64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:54 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d4da21-b99b-4e80-9268-3ded5e7340af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d4da21-b99b-4e80-9268-3ded5e7340af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-635866850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f554e168-7eee-4d2f-8fa6-692719e29a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4840375f-f217-44e5-97cd-b2468c2ebc1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:55Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d23df5-5a8d-4a26-b07e-41c3d19bda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d23df5-5a8d-4a26-b07e-41c3d19bda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11652053-fe5b-4b83-9556-08e216da96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11652053-fe5b-4b83-9556-08e216da96c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f554e168-7eee-4d2f-8fa6-692719e29a63', 'volume_name': 'volume-f554e168-7eee-4d2f-8fa6-692719e29a63', 'volume_size': 1, 'snapshot_id': '4840375f-f217-44e5-97cd-b2468c2ebc1b'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38028c4-5f8e-4ff4-941d-815075398f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38028c4-5f8e-4ff4-941d-815075398f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e62343-0ef8-46ab-a063-b17e5b302d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Volume f554e168-7eee-4d2f-8fa6-692719e29a63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f554e168-7eee-4d2f-8fa6-692719e29a63', 'volume_size': 1, 'snapshot_id': '4840375f-f217-44e5-97cd-b2468c2ebc1b'} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:55 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 1G" returned: 0 in 0.681s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:55 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-023cbaad-60e2-4750-b7d0-728777eaa201" returned: 0 in 0.631s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-023cbaad-60e2-4750-b7d0-728777eaa201" released by "delete_volume" :: held 1.233s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:55 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 Apr 08 17:45:55 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Created reservations ['027cba0e-094e-40dd-a771-0edb56ab997a', 'c7bbe6d6-fedb-4794-b953-b835764e2a01', 'cc8088d3-3655-4ad6-afbb-7af8de122cc4', 'accd73e1-b28c-49d9-b5ad-a14c0f066975'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:55 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:55 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Flow 'volume_create_manager' (8aecec0e-836c-4196-bb49-d1393b2f6565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d03982-c6c8-4fc5-a036-da128ba75684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d03982-c6c8-4fc5-a036-da128ba75684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-492327919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f764568174b04bc8ace2b34f18d963e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:56Z,use_quota=True,user_id='c2f88c64756a48d28e52a3ee74460c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8819f5aa-4049-4ef3-8f61-fe874b28e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8819f5aa-4049-4ef3-8f61-fe874b28e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af49acd-fb24-416f-8db8-861a04311688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af49acd-fb24-416f-8db8-861a04311688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034', 'volume_name': 'volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687087bb-b2a2-44d3-a1b5-dc69885247df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687087bb-b2a2-44d3-a1b5-dc69885247df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe71493-232e-4e59-9c1f-c397ba86371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:55 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Volume a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034', 'volume_size': 1} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:55 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:55 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.477s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:55 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Deleted volume successfully. Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0" returned: 0 in 0.588s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:55 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 is being set with open permissions: ugo+rw Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:55 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 Apr 08 17:45:55 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:55 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8c0e1dd0-4e91-49a9-8669-3d9b22001299 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-023cbaad-60e2-4750-b7d0-728777eaa201-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-24497e0c-c7a9-45c6-b8c9-da0e96539808-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-24497e0c-c7a9-45c6-b8c9-da0e96539808-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:56 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-quobyte-24497e0c-c7a9-45c6-b8c9-da0e96539808" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0" returned: 0 in 0.443s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-24497e0c-c7a9-45c6-b8c9-da0e96539808" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[08417afb-a6e4-49f7-b78e-31f0b04a1005]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:56 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info Apr 08 17:45:56 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:56 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 Apr 08 17:45:56 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:56 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:56 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info is being set with open permissions: ugo+rw Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:56 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info Apr 08 17:45:56 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:56 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808" returned: 0 in 0.495s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:56 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:56 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808 Apr 08 17:45:56 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.info" returned: 0 in 0.393s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.965s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b-f554e168-7eee-4d2f-8fa6-692719e29a63" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b-f554e168-7eee-4d2f-8fa6-692719e29a63" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Creating volume f554e168-7eee-4d2f-8fa6-692719e29a63 from snapshot 4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-f21afdfe-956e-4fa3-af0d-cd531b00e3fe tempest-CreateVolumesFromSnapshotTest-1638062735 None] Create snapshot completed successfully Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] snapshot: 4840375f-f217-44e5-97cd-b2468c2ebc1b, volume: f554e168-7eee-4d2f-8fa6-692719e29a63, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:45:57 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-24497e0c-c7a9-45c6-b8c9-da0e96539808" returned: 0 in 0.439s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf22955a-dccf-410d-a629-256fab82098b]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-24497e0c-c7a9-45c6-b8c9-da0e96539808" released by "delete_volume" :: held 0.972s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Created reservations ['16636850-56ed-4aac-b5ad-2e081e8455c9', 'afbee20f-d133-4930-9268-de85a45907ec', '1c3e3cc3-ce08-4715-b58b-707d96b05b14', '481e8ad7-683a-400d-bc69-b257fffdd933'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:57 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:45:57 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-37bd0cbe-2453-4875-8d12-854127b78eb5-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-37bd0cbe-2453-4875-8d12-854127b78eb5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:57 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:57 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-quobyte-37bd0cbe-2453-4875-8d12-854127b78eb5" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-37bd0cbe-2453-4875-8d12-854127b78eb5" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9755a5e-5dc1-4bf4-b37b-c411685d724e]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:57 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 Apr 08 17:45:57 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd32c1f-99fc-4585-86bc-851704178167]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:57 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:57 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.462s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:57 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Deleted volume successfully. Apr 08 17:45:57 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-fbd5ef0d-634d-4cd8-ac9e-c5e4cf08c2b8 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-24497e0c-c7a9-45c6-b8c9-da0e96539808-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eac07b42-27de-472c-83ef-8c34154ef1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85886e9a-a288-4d58-b9ba-15437a65ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85886e9a-a288-4d58-b9ba-15437a65ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081051259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea1a70-9d7d-4108-8456-618f6ac93889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea1a70-9d7d-4108-8456-618f6ac93889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55103dac-8b30-4b2c-9c4d-73f26d0478b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55103dac-8b30-4b2c-9c4d-73f26d0478b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a', 'volume_name': 'volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67932b2d-329d-4d64-b2b6-b0b3d042facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67932b2d-329d-4d64-b2b6-b0b3d042facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae7a3e8-82c6-4a3a-8c90-5b5f635fc905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a', 'volume_size': 1} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5" returned: 0 in 0.590s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:57 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5 Apr 08 17:45:57 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eee85f16-a40f-4842-874f-840ec15b3b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf22caf-03e6-4cd3-ac9c-bec0f2bc24c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf22caf-03e6-4cd3-ac9c-bec0f2bc24c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528860850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef03ed53-7062-414f-a7df-cef75f6f0648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122da8e5-94b3-46c2-86ad-101a0d805061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122da8e5-94b3-46c2-86ad-101a0d805061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a940b7af-fb79-4bb6-b6bf-c64c1fcab99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a940b7af-fb79-4bb6-b6bf-c64c1fcab99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef03ed53-7062-414f-a7df-cef75f6f0648', 'volume_name': 'volume-ef03ed53-7062-414f-a7df-cef75f6f0648', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d15e37-4a60-4382-9016-66ba5ed586a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d15e37-4a60-4382-9016-66ba5ed586a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d21070c-9744-4ff4-a561-e50435ed0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:57 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume ef03ed53-7062-414f-a7df-cef75f6f0648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef03ed53-7062-414f-a7df-cef75f6f0648', 'volume_size': 1} Apr 08 17:45:57 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eb573e31-dbcb-4e29-97bd-3b2d1afdae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2e4b22-35a8-4630-882d-d445d9086647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2e4b22-35a8-4630-882d-d445d9086647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603033226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3233530-378a-41a5-9631-cbeb1263fa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd7d8d2-23d0-4bcd-9f58-465ecf0cb983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd7d8d2-23d0-4bcd-9f58-465ecf0cb983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e58fb-f5f6-4d63-bc75-8039b1ded3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e58fb-f5f6-4d63-bc75-8039b1ded3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3233530-378a-41a5-9631-cbeb1263fa52', 'volume_name': 'volume-a3233530-378a-41a5-9631-cbeb1263fa52', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fe8a74-1002-4774-ae88-e6a44d99f4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fe8a74-1002-4774-ae88-e6a44d99f4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063effdb-7075-410c-a093-a1c5d2e0aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume a3233530-378a-41a5-9631-cbeb1263fa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3233530-378a-41a5-9631-cbeb1263fa52', 'volume_size': 1} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.680s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:58 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 Apr 08 17:45:58 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:58 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37bd0cbe-2453-4875-8d12-854127b78eb5" returned: 0 in 0.459s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-37bd0cbe-2453-4875-8d12-854127b78eb5" released by "delete_volume" :: held 1.072s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Created reservations ['5a66e47d-6cef-460d-8872-872e1233ce36', 'f7cf2e91-423e-4d31-b699-e00a903e7fad', 'c9f7676d-52ec-4067-bfd6-5890c21edc4b', 'c5073f6e-052b-47a4-a74b-72c63987820d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (7556d59d-1b99-4a34-bed3-47fc96653d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f37689-d526-4b79-acdd-2e88a1b5c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f37689-d526-4b79-acdd-2e88a1b5c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474543438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4603d3f4-d128-4afc-90b7-9c8c780b98d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841fa64f-bc50-40d4-9338-1d44481004c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841fa64f-bc50-40d4-9338-1d44481004c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325b0a96-1ea7-40d8-928c-59e8a73a603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325b0a96-1ea7-40d8-928c-59e8a73a603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4603d3f4-d128-4afc-90b7-9c8c780b98d8', 'volume_name': 'volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b481fa-93be-4398-86af-9fa53552a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b481fa-93be-4398-86af-9fa53552a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca359e4c-aebd-4118-9690-ab671683cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume 4603d3f4-d128-4afc-90b7-9c8c780b98d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8', 'volume_size': 1} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:58 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:45:58 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (f72dd8d6-ff93-4c12-a4da-91b2d941fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0920e-a42b-453b-899b-9bead4064776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0920e-a42b-453b-899b-9bead4064776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582583556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42026e9e-b72a-4cf4-9e65-d6acd53bae24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:59Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998f34a-f5c1-4268-aad0-8004d007e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8998f34a-f5c1-4268-aad0-8004d007e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdca1a1-59b5-4999-b609-e8c71e09f12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdca1a1-59b5-4999-b609-e8c71e09f12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42026e9e-b72a-4cf4-9e65-d6acd53bae24', 'volume_name': 'volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b748e8-3d2f-4694-88cc-ba40ea17f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b748e8-3d2f-4694-88cc-ba40ea17f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6314bd5-5967-4638-906d-e717c07a0ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:45:58 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume 42026e9e-b72a-4cf4-9e65-d6acd53bae24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24', 'volume_size': 1} Apr 08 17:45:58 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:45:59 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.743s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:45:59 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Deleted volume successfully. Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0fe5e7d6-93d5-4043-8a55-be4f42608e4a tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-37bd0cbe-2453-4875-8d12-854127b78eb5-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-c8cc75af-d7c6-45a0-91a7-6098dbf72496-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-c8cc75af-d7c6-45a0-91a7-6098dbf72496-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "cinder-quobyte-c8cc75af-d7c6-45a0-91a7-6098dbf72496" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-c8cc75af-d7c6-45a0-91a7-6098dbf72496" acquired by "delete_volume" :: waited 0.016s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e779656-a98a-450e-8973-2dcbae774000]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:45:59 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:45:59 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 Apr 08 17:45:59 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:00 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63" returned: 0 in 2.196s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:00 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496" returned: 0 in 0.815s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[02986396-97ca-44e0-885c-ebba64c43fd3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:00 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496 Apr 08 17:46:00 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:00 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:46:00 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:00 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c8cc75af-d7c6-45a0-91a7-6098dbf72496" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-quobyte-c8cc75af-d7c6-45a0-91a7-6098dbf72496" released by "delete_volume" :: held 1.308s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Created reservations ['c08602c7-4ce7-4f80-abb2-518e7188a2b2', 'fd634971-7709-4311-8540-38e3e244484c', 'c722b7fd-7823-424c-95e2-fb5df7ff5556', '96295fc7-b1d3-4876-9065-7603b86556bc'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:00 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:01 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:01 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:01 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.588s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:46:01 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Converted 1024.00 MB image at 466.05 MB/s Apr 08 17:46:01 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 is being set with open permissions: ugo+rw Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:01 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 Apr 08 17:46:01 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:01 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Deleted volume successfully. Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-149b6f1a-db2d-4ce2-88b0-3736dad314d9 tempest-CreateVolumesFromImageTest-786338696 None] Lock "cinder-c8cc75af-d7c6-45a0-91a7-6098dbf72496-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:01 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63" returned: 0 in 0.407s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" released by "_copy_volume_from_snapshot" :: held 4.424s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b-f554e168-7eee-4d2f-8fa6-692719e29a63" released by "_create_volume_from_snapshot" :: held 4.446s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.467s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.830s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-492327919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f764568174b04bc8ace2b34f18d963e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:56Z,use_quota=True,user_id='c2f88c64756a48d28e52a3ee74460c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Creating volume a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:01 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:01 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 1073741824 Apr 08 17:46:01 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e62343-0ef8-46ab-a063-b17e5b302d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f554e168-7eee-4d2f-8fa6-692719e29a63', 'volume_size': 1, 'snapshot_id': '4840375f-f217-44e5-97cd-b2468c2ebc1b'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b573d49-517d-4002-903f-919fe46e0cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:01 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Volume volume-f554e168-7eee-4d2f-8fa6-692719e29a63 (f554e168-7eee-4d2f-8fa6-692719e29a63): created successfully Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b573d49-517d-4002-903f-919fe46e0cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:01 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (66282945-1c39-40d1-a901-1b8a5e3cb64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:01 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6451cb6a-37cd-422d-b8ac-fb8bfad517ef tempest-VolumeDependencyTests-659622227 None] Created volume successfully. Apr 08 17:46:02 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 1073741824" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:02 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:02 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:02 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.458s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.701s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1081051259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:02 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-4840375f-f217-44e5-97cd-b2468c2ebc1b-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:02 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a 1073741824 Apr 08 17:46:02 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe71493-232e-4e59-9c1f-c397ba86371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c265ac8-6b55-4011-9ac2-b1d858ceabe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:02 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Volume volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 (a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034): created successfully Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c265ac8-6b55-4011-9ac2-b1d858ceabe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Flow 'volume_create_manager' (8aecec0e-836c-4196-bb49-d1393b2f6565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:02 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-e344860d-dd2b-41e4-945d-435b76378d75 tempest-SnapshotDependencyTests-1602236670 None] Created volume successfully. Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-4840375f-f217-44e5-97cd-b2468c2ebc1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Deleting offline snapshot 4840375f-f217-44e5-97cd-b2468c2ebc1b of volume 9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] snapshot_file for this snap is: volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[931d932b-cd64-41fe-89ec-f4785ce042b8]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:02 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:46:02 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:02 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:02 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:03 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a 1073741824" returned: 0 in 0.669s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:03 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a Apr 08 17:46:03 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:03 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.671s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e16820-e889-42d9-9ef0-8bd041b78754]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:03 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.485s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:03 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:46:03 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (dfacee80-91aa-43ee-867d-de4b03d29f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1de382e-f409-413f-bcb3-9c67ca07b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1de382e-f409-413f-bcb3-9c67ca07b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1704259115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cdad30-8ff0-4c1c-9959-0b7b73d11b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:04Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc1725-aea9-488f-be98-45d571921ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc1725-aea9-488f-be98-45d571921ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5c6845-0dc2-4e29-98b9-dbba202352f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5c6845-0dc2-4e29-98b9-dbba202352f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cdad30-8ff0-4c1c-9959-0b7b73d11b78', 'volume_name': 'volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7427e1a-55cd-4cda-a674-636ff778c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7427e1a-55cd-4cda-a674-636ff778c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c293e8-1c99-4e74-9a84-6fe4c164d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume 90cdad30-8ff0-4c1c-9959-0b7b73d11b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78', 'volume_size': 1} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:03 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" returned: 0 in 0.486s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.760s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528860850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef03ed53-7062-414f-a7df-cef75f6f0648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume ef03ed53-7062-414f-a7df-cef75f6f0648 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:03 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae7a3e8-82c6-4a3a-8c90-5b5f635fc905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a4a8c2-6930-4203-830a-3283c25b2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:03 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 1073741824 Apr 08 17:46:03 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:03 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a (b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a): created successfully Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a4a8c2-6930-4203-830a-3283c25b2988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eac07b42-27de-472c-83ef-8c34154ef1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:03 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-b00dd52e-9134-4651-9f24-99df5eaf4814 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:46:03 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.571s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:03 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:46:03 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:04 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 1073741824" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:04 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 Apr 08 17:46:04 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:04 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:04 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b Apr 08 17:46:04 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:04 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648" returned: 0 in 0.418s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.430s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603033226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3233530-378a-41a5-9631-cbeb1263fa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume a3233530-378a-41a5-9631-cbeb1263fa52 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:04 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d21070c-9744-4ff4-a561-e50435ed0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef03ed53-7062-414f-a7df-cef75f6f0648', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:04 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 1073741824 Apr 08 17:46:04 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393d9fd6-2898-44ee-9585-af0aae0a8754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:04 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-ef03ed53-7062-414f-a7df-cef75f6f0648 (ef03ed53-7062-414f-a7df-cef75f6f0648): created successfully Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393d9fd6-2898-44ee-9585-af0aae0a8754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eee85f16-a40f-4842-874f-840ec15b3b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5f7e5fa1-f9d7-442f-b780-fb74bc919c0d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:46:04 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc.4840375f-f217-44e5-97cd-b2468c2ebc1b" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-4840375f-f217-44e5-97cd-b2468c2ebc1b" released by "_delete_snapshot" :: held 2.197s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" released by "delete_snapshot" :: held 2.207s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Created reservations ['2aa360ae-54e4-4918-a86e-3e5d1e595641', '35d1effe-974f-430f-9aa9-b81d43054f95', '5dd5e465-a4ff-4fa0-8fd1-9d8ee2e048c6', 'bca8826e-c465-4ddc-b152-62490a34ba3a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:04 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Delete snapshot completed successfully. Apr 08 17:46:04 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3b938479-7352-46db-a282-c5c066e5adbc tempest-VolumeDependencyTests-659622227 None] Lock "cinder-4840375f-f217-44e5-97cd-b2468c2ebc1b-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:05 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 1073741824" returned: 0 in 0.481s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:05 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 Apr 08 17:46:05 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:05 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52" returned: 0 in 0.446s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.182s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474543438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4603d3f4-d128-4afc-90b7-9c8c780b98d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:58Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume 4603d3f4-d128-4afc-90b7-9c8c780b98d8 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:05 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063effdb-7075-410c-a093-a1c5d2e0aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3233530-378a-41a5-9631-cbeb1263fa52', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:05 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 1073741824 Apr 08 17:46:05 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af02417-8379-408c-83f7-6c37a117275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:05 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-a3233530-378a-41a5-9631-cbeb1263fa52 (a3233530-378a-41a5-9631-cbeb1263fa52): created successfully Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af02417-8379-408c-83f7-6c37a117275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (eb573e31-dbcb-4e29-97bd-3b2d1afdae42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:05 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-6d2255f9-4d54-4677-9315-474037ccfa35 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-9bbc1796-93ba-440b-96f2-b8f78dba3cdc-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-9bbc1796-93ba-440b-96f2-b8f78dba3cdc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa3339c-13d3-447a-9254-2658cc75db31]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:05 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:05 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:46:05 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:06 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 1073741824" returned: 0 in 0.519s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:06 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 Apr 08 17:46:06 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:06 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:06 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc Apr 08 17:46:06 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:06 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.021s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582583556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42026e9e-b72a-4cf4-9e65-d6acd53bae24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d95e13b05a14f808c66aef023e629b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:45:59Z,use_quota=True,user_id='5fe5a4bd9fb844fba541a8163691d202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Creating volume 42026e9e-b72a-4cf4-9e65-d6acd53bae24 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:06 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca359e4c-aebd-4118-9690-ab671683cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffa30ec-67d7-44a3-8659-1c801de6b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:06 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 1073741824 Apr 08 17:46:06 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:06 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 (4603d3f4-d128-4afc-90b7-9c8c780b98d8): created successfully Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffa30ec-67d7-44a3-8659-1c801de6b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (7556d59d-1b99-4a34-bed3-47fc96653d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:06 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2b1bb982-1d0a-4e17-9551-4e381e76c220 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:46:06 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" returned: 0 in 0.411s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-9bbc1796-93ba-440b-96f2-b8f78dba3cdc" released by "delete_volume" :: held 0.947s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Created reservations ['0cc8dd30-3d27-4104-afe6-8688c7dae107', '109b3161-4c2a-4379-8db7-9d3ad48faee2', '6cd1ec5b-064f-4a91-a1e4-d0b837cf6b06', '195a9216-acfe-4c01-9c4c-d7a5c2241af3'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:06 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:06 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:06 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (10b4923b-f899-40b7-bb5d-453302490449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d06c32-86e6-4e3c-a9a6-04075d5b3880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d06c32-86e6-4e3c-a9a6-04075d5b3880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-205405037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5a0881-2fd6-49cc-aaea-53381343f54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:07Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a37a39-2124-4619-8521-252ebf180713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a37a39-2124-4619-8521-252ebf180713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a5671a-7be4-42a5-8619-6e415de7658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a5671a-7be4-42a5-8619-6e415de7658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5a0881-2fd6-49cc-aaea-53381343f54b', 'volume_name': 'volume-6f5a0881-2fd6-49cc-aaea-53381343f54b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74901239-a4bf-4d56-8651-731b7c35a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74901239-a4bf-4d56-8651-731b7c35a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc763eb3-df13-41fa-961b-49e288a8c596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Volume 6f5a0881-2fd6-49cc-aaea-53381343f54b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5a0881-2fd6-49cc-aaea-53381343f54b', 'volume_size': 1} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:07 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 1073741824" returned: 0 in 0.596s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:07 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.446s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Deleted volume successfully. Apr 08 17:46:07 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 Apr 08 17:46:07 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-4012260d-2f47-4fbb-ae0f-77bd9cea8072 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-9bbc1796-93ba-440b-96f2-b8f78dba3cdc-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:07 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24" returned: 0 in 0.431s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.444s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6314bd5-5967-4638-906d-e717c07a0ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7f2bca-edf5-440b-bf75-89e80b28489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Creating offline snapshot 07f91489-fd9b-46fd-ae1e-a0d0409de084 of volume a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:46:07 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Volume volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 (42026e9e-b72a-4cf4-9e65-d6acd53bae24): created successfully Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7f2bca-edf5-440b-bf75-89e80b28489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Flow 'volume_create_manager' (f72dd8d6-ff93-4c12-a4da-91b2d941fa46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcf1172-04b7-4a5f-87f1-012d04d334c7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:07 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:07 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-506a178d-55d7-4fc7-a236-cefbe6974db7 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created volume successfully. Apr 08 17:46:07 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:07 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:08 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.460s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:08 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 1G Apr 08 17:46:08 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-42026e9e-b72a-4cf4-9e65-d6acd53bae24-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-42026e9e-b72a-4cf4-9e65-d6acd53bae24-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-42026e9e-b72a-4cf4-9e65-d6acd53bae24" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-42026e9e-b72a-4cf4-9e65-d6acd53bae24" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac000a-3e2b-45a1-beee-fe488496ade2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:08 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 Apr 08 17:46:08 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:08 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 1G" returned: 0 in 0.475s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:08 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:08 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:08 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24" returned: 0 in 0.488s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:08 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:08 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24 Apr 08 17:46:08 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:09 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:09 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 is being set with open permissions: ugo+rw Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:09 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:09 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:09 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-42026e9e-b72a-4cf4-9e65-d6acd53bae24" returned: 0 in 0.434s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-42026e9e-b72a-4cf4-9e65-d6acd53bae24" released by "delete_volume" :: held 0.947s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['e3be7fc2-fb35-4a2e-a292-9c49b4acc674', '96c37656-dcfb-42a7-b0a2-1a9a0e38fb2f', 'f12e497e-b9de-4f33-b5dc-cd4c23838409', '710d4044-e0b7-4b6d-8d12-c1dc67959a07'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:09 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:09 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:09 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:09 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info Apr 08 17:46:09 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:09 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:09 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bd30a74c-3bdf-4993-9ec1-2b85da42b79e tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-42026e9e-b72a-4cf4-9e65-d6acd53bae24-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:09 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info" returned: 0 in 0.435s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:09 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info is being set with open permissions: ugo+rw Apr 08 17:46:09 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:10 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info Apr 08 17:46:10 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:10 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.info" returned: 0 in 0.418s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.702s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1704259115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cdad30-8ff0-4c1c-9959-0b7b73d11b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:04Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume 90cdad30-8ff0-4c1c-9959-0b7b73d11b78 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:10 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:10 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 1073741824 Apr 08 17:46:10 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:10 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-27040c8d-5106-4aa3-9a3d-96f523a7ab8c tempest-SnapshotDependencyTests-1602236670 None] Create snapshot completed successfully Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-4603d3f4-d128-4afc-90b7-9c8c780b98d8-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-4603d3f4-d128-4afc-90b7-9c8c780b98d8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-4603d3f4-d128-4afc-90b7-9c8c780b98d8" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-4603d3f4-d128-4afc-90b7-9c8c780b98d8" acquired by "delete_volume" :: waited 0.006s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4933f-f509-4753-8f37-6fc1cee4628b]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:10 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 Apr 08 17:46:10 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:10 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 1073741824" returned: 0 in 0.496s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:10 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:10 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 Apr 08 17:46:10 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:11 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:11 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8 Apr 08 17:46:11 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:11 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" returned: 0 in 0.410s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-205405037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5a0881-2fd6-49cc-aaea-53381343f54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:07Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Creating volume 6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:11 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c293e8-1c99-4e74-9a84-6fe4c164d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4411a00-cd3f-4d0d-a15f-a546680527c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b 1073741824 Apr 08 17:46:11 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:11 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 (90cdad30-8ff0-4c1c-9959-0b7b73d11b78): created successfully Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4411a00-cd3f-4d0d-a15f-a546680527c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (dfacee80-91aa-43ee-867d-de4b03d29f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:11 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0e033891-beed-4c3b-b11b-1c6a93c4ccf6 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:11 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4603d3f4-d128-4afc-90b7-9c8c780b98d8" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-4603d3f4-d128-4afc-90b7-9c8c780b98d8" released by "delete_volume" :: held 0.941s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['d3db45eb-40a0-41b2-95e9-94505236059d', '197f165f-f40e-4268-9712-5402af1929ff', 'f6450fc8-fa3b-42b8-80ec-1fe772c30205', 'ef5a8dd4-ae3d-415c-b712-4782a52ad5a8'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:11 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:11 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-a3233530-378a-41a5-9631-cbeb1263fa52-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-a3233530-378a-41a5-9631-cbeb1263fa52-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-a3233530-378a-41a5-9631-cbeb1263fa52" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-a3233530-378a-41a5-9631-cbeb1263fa52" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a3c6b-bf8e-4230-b2f9-44f8e35b9983]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:11 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 Apr 08 17:46:11 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Flow 'volume_create_manager' (95af5c3f-bb4e-4bc5-9553-754614270df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8d6301-6886-4644-b78c-f5702da848e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8d6301-6886-4644-b78c-f5702da848e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953a97c7-9d73-49bb-8284-cd8d3a2db51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f764568174b04bc8ace2b34f18d963e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07f91489-fd9b-46fd-ae1e-a0d0409de084,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:12Z,use_quota=True,user_id='c2f88c64756a48d28e52a3ee74460c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c851973-8e24-47ba-8ee6-548d0174d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c851973-8e24-47ba-8ee6-548d0174d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e67a3e5-d9df-4b67-aca4-b2b0e56354c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e67a3e5-d9df-4b67-aca4-b2b0e56354c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '953a97c7-9d73-49bb-8284-cd8d3a2db51a', 'volume_name': 'volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a', 'volume_size': 1, 'snapshot_id': '07f91489-fd9b-46fd-ae1e-a0d0409de084'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48ebc72-d0ee-4bfe-bb3b-edcfcd3f2e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48ebc72-d0ee-4bfe-bb3b-edcfcd3f2e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30b7d34-bc0d-4d8e-bc1f-10fd8ed1f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:11 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Volume 953a97c7-9d73-49bb-8284-cd8d3a2db51a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a', 'volume_size': 1, 'snapshot_id': '07f91489-fd9b-46fd-ae1e-a0d0409de084'} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:11 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b 1073741824" returned: 0 in 0.587s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:11 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:12 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.544s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-5b544c66-bd9f-418f-86d6-e933e28be8c0 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-4603d3f4-d128-4afc-90b7-9c8c780b98d8-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (35b4cb2b-d264-4992-825b-7ad49a5c6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374b3937-cb06-4eba-bdf0-8ac71dc41bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374b3937-cb06-4eba-bdf0-8ac71dc41bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306163882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37b827d-1832-4ce7-b921-780a6a80e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:12Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420685ac-89f6-4ee7-a99e-c7387db1b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420685ac-89f6-4ee7-a99e-c7387db1b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a9f87-9b41-46af-addc-e87830f1d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0a9f87-9b41-46af-addc-e87830f1d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37b827d-1832-4ce7-b921-780a6a80e474', 'volume_name': 'volume-e37b827d-1832-4ce7-b921-780a6a80e474', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4124106-d865-439d-ba45-d0fa04e39c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4124106-d865-439d-ba45-d0fa04e39c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c530e92e-cc6d-4752-a179-4b0767c5aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume e37b827d-1832-4ce7-b921-780a6a80e474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37b827d-1832-4ce7-b921-780a6a80e474', 'volume_size': 1} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52" returned: 0 in 0.667s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:12 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52 Apr 08 17:46:12 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:12 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.490s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.543s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084-953a97c7-9d73-49bb-8284-cd8d3a2db51a" by "_create_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc763eb3-df13-41fa-961b-49e288a8c596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5a0881-2fd6-49cc-aaea-53381343f54b', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4e6d5-7f60-47bc-810f-badd947dd95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (df781c47-e62d-4f8d-9bcd-b470f7964653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8334e4d0-0667-41c9-9191-096b20fa0427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Volume volume-6f5a0881-2fd6-49cc-aaea-53381343f54b (6f5a0881-2fd6-49cc-aaea-53381343f54b): created successfully Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4e6d5-7f60-47bc-810f-badd947dd95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (10b4923b-f899-40b7-bb5d-453302490449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084-953a97c7-9d73-49bb-8284-cd8d3a2db51a" acquired by "_create_volume_from_snapshot" :: waited 0.076s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Creating volume 953a97c7-9d73-49bb-8284-cd8d3a2db51a from snapshot 07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8334e4d0-0667-41c9-9191-096b20fa0427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-526672045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f22b28-d1b0-46d1-b971-e81c55e7a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:12Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6799eff-ed8c-4b90-b81d-8e6472c620b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6799eff-ed8c-4b90-b81d-8e6472c620b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643e84e3-2ab0-44e5-9336-a49cf14ba016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643e84e3-2ab0-44e5-9336-a49cf14ba016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f22b28-d1b0-46d1-b971-e81c55e7a631', 'volume_name': 'volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fff4b1-8a21-4b73-8ed0-86f1db7f46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fff4b1-8a21-4b73-8ed0-86f1db7f46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ffca5d-0a85-4e4f-8a78-a8909138658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume c9f22b28-d1b0-46d1-b971-e81c55e7a631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631', 'volume_size': 1} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a40ef73b-9cfd-4df5-8ed0-c2fee3aaeb3c tempest-VolumeDependencyTests-659622227 None] Created volume successfully. Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] snapshot: 07f91489-fd9b-46fd-ae1e-a0d0409de084, volume: 953a97c7-9d73-49bb-8284-cd8d3a2db51a, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f609cb-6485-4b77-9172-0582dcdfc469]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (6426067e-ef4a-4429-9671-9887b585060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c999588-72a2-4029-89bd-2adf918e1646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c999588-72a2-4029-89bd-2adf918e1646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1754427966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91b23a9-16ed-4053-946d-4bc13ce9a7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:12 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9038299c-b1dc-4a26-ad08-58db64195a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9038299c-b1dc-4a26-ad08-58db64195a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e57dbc6-7ecf-462a-b153-5aa2115533ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e57dbc6-7ecf-462a-b153-5aa2115533ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b91b23a9-16ed-4053-946d-4bc13ce9a7d2', 'volume_name': 'volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cd5535-b939-4ab2-9968-7fd50f569649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cd5535-b939-4ab2-9968-7fd50f569649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc934a7e-c9e5-4ceb-8f11-910578f15bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume b91b23a9-16ed-4053-946d-4bc13ce9a7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2', 'volume_size': 1} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (47567028-8ad2-4e3e-9897-32ea0a0b3317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6fc340-59d9-4324-873e-feb035215dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6fc340-59d9-4324-873e-feb035215dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056213811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37038d76-1ef3-490f-a4d2-0e38a8422298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a624855-2e47-4e49-b06e-ad47050a20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a624855-2e47-4e49-b06e-ad47050a20eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b693c1a-9c43-4c91-a34b-c848bc2a0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b693c1a-9c43-4c91-a34b-c848bc2a0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37038d76-1ef3-490f-a4d2-0e38a8422298', 'volume_name': 'volume-37038d76-1ef3-490f-a4d2-0e38a8422298', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421e8c6-66d6-4b4b-9e72-c20c406798da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6421e8c6-66d6-4b4b-9e72-c20c406798da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd11e0de-aedd-4c55-a95f-a2b87e22b15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:12 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume 37038d76-1ef3-490f-a4d2-0e38a8422298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37038d76-1ef3-490f-a4d2-0e38a8422298', 'volume_size': 1} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:12 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a3233530-378a-41a5-9631-cbeb1263fa52" returned: 0 in 0.588s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:12 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-a3233530-378a-41a5-9631-cbeb1263fa52" released by "delete_volume" :: held 1.278s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['3cd49df9-ab1b-402e-b27f-0d8535447133', '9c582abe-0db5-4183-855b-20a0e7a8ccf7', '58e8d484-ae83-4eba-95ce-9e03b95d067d', '70464d21-fa1d-41aa-b525-af3a5e07e628'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:13 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:13 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (f2245cb2-d394-4b94-873a-ba7b487d2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce92a06-7835-4408-b71e-71896065a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce92a06-7835-4408-b71e-71896065a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122501171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df73b38-1f8c-4e46-87ea-e16a2d80efde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2997f205-a9b4-4871-b0b9-5923cca19312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2997f205-a9b4-4871-b0b9-5923cca19312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9043f6-47fc-4e32-8d65-14f28ab076ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9043f6-47fc-4e32-8d65-14f28ab076ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df73b38-1f8c-4e46-87ea-e16a2d80efde', 'volume_name': 'volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5873c1bb-62ce-4bd7-80c3-6321f0e6c337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5873c1bb-62ce-4bd7-80c3-6321f0e6c337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6148122-a293-4d81-b463-91302c9ba8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume 6df73b38-1f8c-4e46-87ea-e16a2d80efde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde', 'volume_size': 1} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:13 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.556s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[215704ab-5bbf-46ed-9dc9-dce248678b15]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:13 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:13 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:13 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:13 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3849670c-c9f2-4ecc-b740-10995a366cbf tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-a3233530-378a-41a5-9631-cbeb1263fa52-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (cd4d6d66-1a92-4ae5-af42-f3973cdca62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5332d5e2-1668-4c6b-b97b-161bb668d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5332d5e2-1668-4c6b-b97b-161bb668d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1180132608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a85408-6108-4fb4-b17c-dd9a43176ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bf1a7f533d40ccb9da311e2c1d3617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6f5a0881-2fd6-49cc-aaea-53381343f54b,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:14Z,use_quota=True,user_id='c2b539538a6e4a4b85816b68d71977cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65488eea-93d5-4376-8de9-09887ab861a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65488eea-93d5-4376-8de9-09887ab861a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b4baeb-2b15-40a1-97f5-a3f041b77208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b4baeb-2b15-40a1-97f5-a3f041b77208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85a85408-6108-4fb4-b17c-dd9a43176ad5', 'volume_name': 'volume-85a85408-6108-4fb4-b17c-dd9a43176ad5', 'volume_size': 1, 'source_volid': '6f5a0881-2fd6-49cc-aaea-53381343f54b', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149c5eeb-56a0-4bef-876c-136ba53ecb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149c5eeb-56a0-4bef-876c-136ba53ecb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d000d84-c77f-4eb1-8865-48a1ba79fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:13 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Volume 85a85408-6108-4fb4-b17c-dd9a43176ad5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85a85408-6108-4fb4-b17c-dd9a43176ad5', 'volume_size': 1, 'source_volid': '6f5a0881-2fd6-49cc-aaea-53381343f54b', 'source_volstatus': 'available'} Apr 08 17:46:13 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.521s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:13 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a Apr 08 17:46:13 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-ef03ed53-7062-414f-a7df-cef75f6f0648-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-ef03ed53-7062-414f-a7df-cef75f6f0648-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-ef03ed53-7062-414f-a7df-cef75f6f0648" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-ef03ed53-7062-414f-a7df-cef75f6f0648" acquired by "delete_volume" :: waited 0.022s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d27fcb-2251-4585-ab4d-61c74696969d]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:13 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:13 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 Apr 08 17:46:13 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:15 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648" returned: 0 in 1.168s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:15 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648 Apr 08 17:46:15 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:15 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a" returned: 0 in 2.055s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4672e4e3-2a56-49bf-bbee-83fb436b2288]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:15 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-ef03ed53-7062-414f-a7df-cef75f6f0648" returned: 0 in 0.789s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-ef03ed53-7062-414f-a7df-cef75f6f0648" released by "delete_volume" :: held 1.980s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:15 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:15 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['836f2fcd-b905-4aef-9caf-8679368c825b', '8c0d15b9-67ba-4905-be39-11863a46efa8', '7fa48a80-828c-4f14-a756-e1203f8b4a31', 'e0df2597-4e30-4df5-b361-eac91335f02b'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:15 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:15 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:15 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd543180-098d-4d26-9ae8-e98ee6782637]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:16 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a Apr 08 17:46:16 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:16 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.427s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-31bc71be-7d83-45df-81b3-a65ac182b5fd tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-ef03ed53-7062-414f-a7df-cef75f6f0648-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:16 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.675s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:46:16 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Converted 1024.00 MB image at 497.86 MB/s Apr 08 17:46:16 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a is being set with open permissions: ugo+rw Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:16 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a Apr 08 17:46:16 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:16 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:16 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a Apr 08 17:46:16 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:16 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a" returned: 0 in 0.426s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" released by "_copy_volume_from_snapshot" :: held 4.289s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084-953a97c7-9d73-49bb-8284-cd8d3a2db51a" released by "_create_volume_from_snapshot" :: held 4.353s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.430s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.548s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306163882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37b827d-1832-4ce7-b921-780a6a80e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:12Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume e37b827d-1832-4ce7-b921-780a6a80e474 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:16 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:16 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 1073741824 Apr 08 17:46:16 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30b7d34-bc0d-4d8e-bc1f-10fd8ed1f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a', 'volume_size': 1, 'snapshot_id': '07f91489-fd9b-46fd-ae1e-a0d0409de084'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c31cd76-e96e-48af-aea1-cfaf251f675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:16 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Volume volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a (953a97c7-9d73-49bb-8284-cd8d3a2db51a): created successfully Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c31cd76-e96e-48af-aea1-cfaf251f675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:16 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Flow 'volume_create_manager' (95af5c3f-bb4e-4bc5-9553-754614270df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:16 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-18254271-41a2-4164-9ace-f69dfe3c828a tempest-SnapshotDependencyTests-1602236670 None] Created volume successfully. Apr 08 17:46:17 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" returned: 0 in 0.429s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a" released by "delete_volume" :: held 0.932s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['04577204-6ffe-427e-bc26-d4bf8fd06412', 'e3226244-b379-496f-8616-90647ca737ae', '0be4dc36-d32d-4f41-adf3-4029d5e3a9aa', '25b8c713-b3d6-4fe9-a842-ffdb18c99da3'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:17 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-718541ba-e7bd-4a52-a29b-31a88068b6f0-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-07f91489-fd9b-46fd-ae1e-a0d0409de084-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-718541ba-e7bd-4a52-a29b-31a88068b6f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-07f91489-fd9b-46fd-ae1e-a0d0409de084-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-718541ba-e7bd-4a52-a29b-31a88068b6f0" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Deleting offline snapshot 07f91489-fd9b-46fd-ae1e-a0d0409de084 of volume a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] snapshot_file for this snap is: volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-718541ba-e7bd-4a52-a29b-31a88068b6f0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleting offline snapshot 718541ba-e7bd-4a52-a29b-31a88068b6f0 of volume c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] snapshot_file for this snap is: volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aeb1bb-7733-4a11-a225-382ac01292cd]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f155c-3c60-4dbd-bba2-274d96c22d18]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:17 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 Apr 08 17:46:17 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 1073741824" returned: 0 in 0.573s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 Apr 08 17:46:17 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:17 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-78dd9c64-1521-45f9-8d97-af21e9264d7a tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-b6822b66-b6bb-4fbe-9b6d-67ab3a7bae5a-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:17 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:17 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0" returned: 0 in 0.522s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ccda3b-4054-4152-b074-d654017ed129]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4291a7-15b2-442a-b6d0-7b0cc148dd6f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:17 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 Apr 08 17:46:17 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474" returned: 0 in 0.432s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.346s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-526672045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f22b28-d1b0-46d1-b971-e81c55e7a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:12Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume c9f22b28-d1b0-46d1-b971-e81c55e7a631 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:17 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c530e92e-cc6d-4752-a179-4b0767c5aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37b827d-1832-4ce7-b921-780a6a80e474', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553e86c1-a743-48b6-9cc6-4e2dfe235f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:17 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 1073741824 Apr 08 17:46:17 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:17 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-e37b827d-1832-4ce7-b921-780a6a80e474 (e37b827d-1832-4ce7-b921-780a6a80e474): created successfully Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553e86c1-a743-48b6-9cc6-4e2dfe235f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:17 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (35b4cb2b-d264-4992-825b-7ad49a5c6376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:18 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-53bb0680-96ba-4168-bbf8-7782733d0763 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:18 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 Apr 08 17:46:18 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.555s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:18 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 1073741824" returned: 0 in 0.542s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 Apr 08 17:46:18 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0 Apr 08 17:46:18 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084 Apr 08 17:46:18 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631" returned: 0 in 0.422s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.204s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1754427966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91b23a9-16ed-4053-946d-4bc13ce9a7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume b91b23a9-16ed-4053-946d-4bc13ce9a7d2 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:18 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ffca5d-0a85-4e4f-8a78-a8909138658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4945951-599e-4079-a7f7-6d9ba978c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:18 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 1073741824 Apr 08 17:46:18 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:18 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 (c9f22b28-d1b0-46d1-b971-e81c55e7a631): created successfully Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4945951-599e-4079-a7f7-6d9ba978c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:18 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (df781c47-e62d-4f8d-9bcd-b470f7964653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-1ff88ab3-e94e-49b3-a13c-2ca37ba53344 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:19 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126.718541ba-e7bd-4a52-a29b-31a88068b6f0" returned: 0 in 0.422s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-718541ba-e7bd-4a52-a29b-31a88068b6f0" released by "_delete_snapshot" :: held 1.964s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" released by "delete_snapshot" :: held 2.000s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034.07f91489-fd9b-46fd-ae1e-a0d0409de084" returned: 0 in 0.438s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-07f91489-fd9b-46fd-ae1e-a0d0409de084" released by "_delete_snapshot" :: held 2.041s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" released by "delete_snapshot" :: held 2.065s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['38ab2750-6e1a-45b8-96c6-91b2f84bc40f', '2d65acf3-4af5-4ad0-aaab-19b09d9ffc02', '71acd946-59c6-4716-a3b2-ac5d5340f9bd', '00849db3-b4fa-4fc2-886f-c5813384c9a4'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Delete snapshot completed successfully. Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-14d82fd3-108e-4418-a462-e032ec56a0f8 tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-718541ba-e7bd-4a52-a29b-31a88068b6f0-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Created reservations ['5f359077-0965-4d0d-9229-759aceeed0df', '044ff7a3-69d3-41bd-a12a-a907c8bdc7ce', 'd025aad4-851d-4c1b-8ea9-8b39b21a39c1', '38cebcc3-ba23-450a-af5b-644dbd754b11'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Delete snapshot completed successfully. Apr 08 17:46:19 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-301f65ac-f45d-49ca-b7a9-f32368c73865 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-07f91489-fd9b-46fd-ae1e-a0d0409de084-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 1073741824" returned: 0 in 0.504s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:19 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 Apr 08 17:46:19 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:19 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" returned: 0 in 0.415s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.990s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056213811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37038d76-1ef3-490f-a4d2-0e38a8422298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume 37038d76-1ef3-490f-a4d2-0e38a8422298 {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc934a7e-c9e5-4ceb-8f11-910578f15bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c250802c-dc5f-4fc4-8b80-9d497388d42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:19 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 1073741824 Apr 08 17:46:19 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 (b91b23a9-16ed-4053-946d-4bc13ce9a7d2): created successfully Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c250802c-dc5f-4fc4-8b80-9d497388d42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:19 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (6426067e-ef4a-4429-9671-9887b585060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:19 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-5ddd7d0d-8404-489b-91b3-eb7d5807e91f tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:20 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-c44c1b33-8f5e-425a-8d3c-8e31b84b9126-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 1073741824" returned: 0 in 0.478s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-c44c1b33-8f5e-425a-8d3c-8e31b84b9126-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:20 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 Apr 08 17:46:20 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090e2e5-99a3-4539-b7f4-bb05f7de2e75]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f1500a-777b-473c-9caf-3b5b3343a97f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:20 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 Apr 08 17:46:20 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:20 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:20 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:20 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298" returned: 0 in 0.442s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.716s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122501171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df73b38-1f8c-4e46-87ea-e16a2d80efde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ab00ddcf35c420a9f91988c5808d71a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:13Z,use_quota=True,user_id='f280cb31e4f0441491d59b02853d13e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Creating volume 6df73b38-1f8c-4e46-87ea-e16a2d80efde {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:20 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd11e0de-aedd-4c55-a95f-a2b87e22b15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37038d76-1ef3-490f-a4d2-0e38a8422298', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:20 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde 1073741824 Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70130354-5f66-4742-92e5-81943b3f6107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:20 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:20 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-37038d76-1ef3-490f-a4d2-0e38a8422298 (37038d76-1ef3-490f-a4d2-0e38a8422298): created successfully Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70130354-5f66-4742-92e5-81943b3f6107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:20 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (47567028-8ad2-4e3e-9897-32ea0a0b3317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:20 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-65813ec6-38c0-4233-bed2-5c9c83aad7fe tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:21 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" returned: 0 in 0.537s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126 Apr 08 17:46:21 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034 Apr 08 17:46:21 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:21 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:21 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde 1073741824" returned: 0 in 0.524s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde Apr 08 17:46:21 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:21 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" returned: 0 in 0.426s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-quobyte-c44c1b33-8f5e-425a-8d3c-8e31b84b9126" released by "delete_volume" :: held 1.008s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:21 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" returned: 0 in 0.482s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Created reservations ['6f5006d4-297d-4eb9-b465-676c7a8d9f97', '1736bfb3-81ef-4876-a402-2450c9664e81', 'd1b3f069-6785-496f-b692-4cff4a2e5cb2', 'cb1369cf-07a3-4bc3-af0a-fac21a88c3f4'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034" released by "delete_volume" :: held 1.035s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:21 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Created reservations ['49b0f868-25fc-4046-a839-d1d537889dc4', '15f6ded0-5147-42dc-ad2d-3273bd6c7d11', 'cce13682-62cc-48fe-bba9-4c8b849b1a18', 'd2e3c9ec-b1dc-43a7-b954-c6109c3f9329'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:21 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:21 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde" returned: 0 in 0.412s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.090s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:21 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Cloning volume 6f5a0881-2fd6-49cc-aaea-53381343f54b to volume 85a85408-6108-4fb4-b17c-dd9a43176ad5 Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6148122-a293-4d81-b463-91302c9ba8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c3248b-ca28-4061-9371-6c19deb4089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Creating offline snapshot 6f6587f2-19db-4017-aa6a-834cdb285763 of volume 6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:46:21 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Volume volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde (6df73b38-1f8c-4e46-87ea-e16a2d80efde): created successfully Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c3248b-ca28-4061-9371-6c19deb4089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Flow 'volume_create_manager' (f2245cb2-d394-4b94-873a-ba7b487d2522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3857a7c3-6a36-4e82-a08c-3962c01e9a97]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:21 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:21 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-4c2ebc43-75da-459a-a900-4b6803f1b9a4 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created volume successfully. Apr 08 17:46:21 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:21 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:22 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.452s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Deleted volume successfully. Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-3aaee38c-8ec7-4532-b490-477c52ab887d tempest-CreateVolumesFromSnapshotTest-1638062735 None] Lock "cinder-c44c1b33-8f5e-425a-8d3c-8e31b84b9126-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:22 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:22 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Deleted volume successfully. Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-2ce7b785-c345-48a7-98f3-eb1f14810dad tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-a7d0e6f4-f72a-4ad9-ab8b-056b1bee2034-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:22 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:22 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 1G Apr 08 17:46:22 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-953a97c7-9d73-49bb-8284-cd8d3a2db51a-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-953a97c7-9d73-49bb-8284-cd8d3a2db51a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a86fef-9d99-4136-b0f6-b203a2beecd5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:22 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a Apr 08 17:46:22 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-6df73b38-1f8c-4e46-87ea-e16a2d80efde-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-6df73b38-1f8c-4e46-87ea-e16a2d80efde-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-6df73b38-1f8c-4e46-87ea-e16a2d80efde" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-6df73b38-1f8c-4e46-87ea-e16a2d80efde" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b87b4f-75ca-4284-af86-ae8d334f2a6f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:22 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 1G" returned: 0 in 0.574s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:22 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5a0881-2fd6-49cc-aaea-53381343f54b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:22 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5a0881-2fd6-49cc-aaea-53381343f54b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:22 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde Apr 08 17:46:23 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a" returned: 0 in 0.547s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:23 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a Apr 08 17:46:23 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5a0881-2fd6-49cc-aaea-53381343f54b -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.562s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:23 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 is being set with open permissions: ugo+rw Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:23 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde" returned: 0 in 0.608s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:23 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde Apr 08 17:46:23 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:23 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-953a97c7-9d73-49bb-8284-cd8d3a2db51a" returned: 0 in 0.491s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-quobyte-953a97c7-9d73-49bb-8284-cd8d3a2db51a" released by "delete_volume" :: held 1.072s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Created reservations ['58060472-56ef-49ec-ac0b-d00e4d46912d', 'd8f06a2e-125c-4723-b1a3-1ecdc9c30bdc', '48fa4afa-8ee3-46cb-8e84-3898bfc8d61b', 'a659a978-de73-438d-a016-6912b16649f2'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:23 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:23 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:23 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:23 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:23 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6df73b38-1f8c-4e46-87ea-e16a2d80efde" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-6df73b38-1f8c-4e46-87ea-e16a2d80efde" released by "delete_volume" :: held 1.117s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:24 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info Apr 08 17:46:24 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['d378d7da-f026-4e51-8df1-dca636027324', 'c0446647-0f72-4509-8500-71ff13c817c0', '3460ede7-6bf4-4a5b-8b3e-2b074aee8b19', 'c186f476-5ca5-4974-a035-f38499087e4a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:24 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:24 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:24 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.449s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Deleted volume successfully. Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970c56a7-4010-4873-afd0-a5b53be34ca4 tempest-SnapshotDependencyTests-1602236670 None] Lock "cinder-953a97c7-9d73-49bb-8284-cd8d3a2db51a-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:24 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:24 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info is being set with open permissions: ugo+rw Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:24 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info Apr 08 17:46:24 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:24 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.423s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:24 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-19c555a1-9d43-4991-b453-223e07ed1eb7 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-6df73b38-1f8c-4e46-87ea-e16a2d80efde-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:24 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.info" returned: 0 in 0.431s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" by "_copy_volume_from_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] snapshot: 6f6587f2-19db-4017-aa6a-834cdb285763, volume: 85a85408-6108-4fb4-b17c-dd9a43176ad5, {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[71516457-0feb-46c5-8b0f-bb62e54b5e84]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:24 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:24 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:24 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-37038d76-1ef3-490f-a4d2-0e38a8422298-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-37038d76-1ef3-490f-a4d2-0e38a8422298-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-37038d76-1ef3-490f-a4d2-0e38a8422298" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-37038d76-1ef3-490f-a4d2-0e38a8422298" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d833766-1a26-4a91-b18a-c5b3bab0e15c]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:25 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 Apr 08 17:46:25 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:25 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.538s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5a0881-2fd6-49cc-aaea-53381343f54b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Creating direct copy from snapshot {{(pid=82664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48397b9-72b7-41d8-ba19-073a9a5e5de2]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:25 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:25 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:25 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298" returned: 0 in 0.548s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:25 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:25 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298 Apr 08 17:46:25 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:26 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.563s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG cinder.utils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Path /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 not found in is_blk_device check {{(pid=82664) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:26 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 Apr 08 17:46:26 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:26 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-37038d76-1ef3-490f-a4d2-0e38a8422298" returned: 0 in 0.460s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-37038d76-1ef3-490f-a4d2-0e38a8422298" released by "delete_volume" :: held 1.032s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['a0c26565-24d5-4688-9e41-c4cba30965fe', '91f57425-9614-4b9c-9bda-c5bf88088de4', 'fb6f1622-0daa-46ad-b874-2694b8e379ea', '1147d280-d50d-4fe9-8602-01731c9a7967'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:26 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:26 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:26 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:27 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.816s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:27 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-bf6f8e71-1b8b-42ac-b6db-e1ca7d032041 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-37038d76-1ef3-490f-a4d2-0e38a8422298-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-b91b23a9-16ed-4053-946d-4bc13ce9a7d2-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-b91b23a9-16ed-4053-946d-4bc13ce9a7d2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" acquired by "delete_volume" :: waited 0.033s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc978516-224a-4d62-8aa8-24ddd3d8dbdc]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:27 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:27 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 Apr 08 17:46:27 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:28 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5" returned: 0 in 2.285s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:28 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bcbcc3-2f7e-4f55-a37e-b67033582ae3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:28 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:28 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:28 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" returned: 0 in 1.037s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:28 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:28 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2 Apr 08 17:46:28 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:29 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" returned: 0 in 0.443s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-b91b23a9-16ed-4053-946d-4bc13ce9a7d2" released by "delete_volume" :: held 1.543s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:29 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.737s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.image.image_utils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 {{(pid=82664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 08 17:46:29 devstack cinder-volume[82664]: INFO cinder.image.image_utils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Converted 1024.00 MB image at 447.82 MB/s Apr 08 17:46:29 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 is being set with open permissions: ugo+rw Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['1ebd484e-bc5a-486b-a80b-a77dd7d64ccc', 'bd55abcf-f484-4336-af55-eaeb5ac3b8e8', 'd1b9f292-e3b9-4193-980d-9831c5b0d6cf', '33b72825-1e60-4e2d-a0a8-705090a106ed'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:29 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 Apr 08 17:46:29 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:29 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:29 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:29 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5" returned: 0 in 0.433s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" released by "_copy_volume_from_snapshot" :: held 4.613s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-6f6587f2-19db-4017-aa6a-834cdb285763" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-6f6587f2-19db-4017-aa6a-834cdb285763" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Deleting offline snapshot 6f6587f2-19db-4017-aa6a-834cdb285763 of volume 6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] snapshot_file for this snap is: volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa5e2c-f57a-4ca2-8667-acb7a7417478]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:29 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:29 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:29 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:29 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-0ad90d50-1db1-48da-9b63-529de5629fe8 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-b91b23a9-16ed-4053-946d-4bc13ce9a7d2-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-c9f22b28-d1b0-46d1-b971-e81c55e7a631-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-c9f22b28-d1b0-46d1-b971-e81c55e7a631-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=187,cinder:INSERT=59,cinder:UPDATE=259,cinder:DELETE=21 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-c9f22b28-d1b0-46d1-b971-e81c55e7a631" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-c9f22b28-d1b0-46d1-b971-e81c55e7a631" acquired by "delete_volume" :: waited 0.017s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d54a4-d35b-42e0-bd12-46ba3921aba7]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:29 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:29 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 Apr 08 17:46:29 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:30 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5a0881-2fd6-49cc-aaea-53381343f54b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[937caa79-a56c-4252-ad7d-264d51829028]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:30 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:30 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:30 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631" returned: 0 in 0.589s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:30 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631 Apr 08 17:46:30 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:30 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.575s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:30 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:30 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:30 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-c9f22b28-d1b0-46d1-b971-e81c55e7a631" returned: 0 in 0.525s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-c9f22b28-d1b0-46d1-b971-e81c55e7a631" released by "delete_volume" :: held 1.137s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['4824f05a-6d01-4ecc-9350-56e969ec494f', '2c55a2a7-2f13-44d4-bb4d-fc7efc2c71f3', '5cba5d75-c8af-414e-b9cc-c2b90f25feea', '058c5dbd-2bac-4afe-932f-ed807fe52744'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:30 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:31 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:31 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:31 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.488s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:31 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763 Apr 08 17:46:31 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:31 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.469s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-8d363bc0-ca7e-46bc-baae-0b999161937e tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-c9f22b28-d1b0-46d1-b971-e81c55e7a631-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:31 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b.6f6587f2-19db-4017-aa6a-834cdb285763" returned: 0 in 0.467s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-6f6587f2-19db-4017-aa6a-834cdb285763" released by "_delete_snapshot" :: held 2.103s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.804s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d000d84-c77f-4eb1-8865-48a1ba79fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a85408-6108-4fb4-b17c-dd9a43176ad5', 'volume_size': 1, 'source_volid': '6f5a0881-2fd6-49cc-aaea-53381343f54b', 'source_volstatus': 'available'}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f34275-4411-42f0-bc90-2bf144520426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:31 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Volume volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 (85a85408-6108-4fb4-b17c-dd9a43176ad5): created successfully Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f34275-4411-42f0-bc90-2bf144520426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Flow 'volume_create_manager' (cd4d6d66-1a92-4ae5-af42-f3973cdca62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:31 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9346e503-927b-4b7c-a7c0-d4a15b09367e tempest-VolumeDependencyTests-659622227 None] Created volume successfully. Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-e37b827d-1832-4ce7-b921-780a6a80e474-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-e37b827d-1832-4ce7-b921-780a6a80e474-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-e37b827d-1832-4ce7-b921-780a6a80e474" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-e37b827d-1832-4ce7-b921-780a6a80e474" acquired by "delete_volume" :: waited 0.018s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[93321cd5-26df-4e00-8f6d-384e41df7f6a]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:31 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:32 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 Apr 08 17:46:32 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:32 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:32 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474 Apr 08 17:46:32 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-6f5a0881-2fd6-49cc-aaea-53381343f54b-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-6f5a0881-2fd6-49cc-aaea-53381343f54b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-6f5a0881-2fd6-49cc-aaea-53381343f54b" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-6f5a0881-2fd6-49cc-aaea-53381343f54b" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3a778-e70a-4f98-82a5-e51715100cc6]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:32 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-e37b827d-1832-4ce7-b921-780a6a80e474" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-e37b827d-1832-4ce7-b921-780a6a80e474" released by "delete_volume" :: held 0.936s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:32 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:32 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['ee901e4a-4bce-4867-a0e0-0ed353fc9ba8', '92de5f1d-a2b8-40a7-b5ee-49559cd0812d', '52cb9e74-a43e-4495-891f-97db4fd48c09', 'd263e3df-e1a2-45ec-bf3c-f816a4b3b2a4'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:32 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:33 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:33 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-90cdad30-8ff0-4c1c-9959-0b7b73d11b78-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-90cdad30-8ff0-4c1c-9959-0b7b73d11b78-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "cinder-quobyte-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[376849fd-677b-4ece-9fcc-f1811a3cdae5]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:33 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 Apr 08 17:46:33 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:33 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.523s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:33 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b Apr 08 17:46:33 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:33 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.442s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:33 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-d63c4588-daf0-4af0-8149-00e6ac713b97 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-e37b827d-1832-4ce7-b921-780a6a80e474-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:33 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" returned: 0 in 0.489s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:33 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78 Apr 08 17:46:33 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:33 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-6f5a0881-2fd6-49cc-aaea-53381343f54b" returned: 0 in 0.434s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-6f5a0881-2fd6-49cc-aaea-53381343f54b" released by "delete_volume" :: held 0.996s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Created reservations ['a219d720-d654-48dc-b688-5e6dcae6a6a0', '9756cbc4-b476-4156-ac4a-94c72e340dfa', '9a37a24a-e7bf-4c62-a74b-06e73293ec57', '1907394b-7dfe-4304-9f80-6396cce07441'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-85a85408-6108-4fb4-b17c-dd9a43176ad5-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:33 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-85a85408-6108-4fb4-b17c-dd9a43176ad5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:33 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" acquired by "delete_volume" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d26474f-da36-49c0-8ace-3c8b6c4ca513]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:33 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:34 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:34 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 Apr 08 17:46:34 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" returned: 0 in 0.451s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-quobyte-90cdad30-8ff0-4c1c-9959-0b7b73d11b78" released by "delete_volume" :: held 0.959s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Created reservations ['7340ca15-f073-4498-8a8d-0e1aa5d42137', '54d3815e-0675-4d48-9641-cd540c5fb107', '21ab5985-3ef3-4014-9377-87cb6ff0d346', 'd37ab592-5775-4a57-9ed6-89c9fd56251a'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:34 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:34 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:34 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.480s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Deleted volume successfully. Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-7be5160d-f2d7-4e00-a557-d753682f7fc8 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-6f5a0881-2fd6-49cc-aaea-53381343f54b-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:34 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5" returned: 0 in 0.483s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:34 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5 Apr 08 17:46:34 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:34 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.498s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:34 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Deleted volume successfully. Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c6dc72b8-c81a-47fb-b0a8-910b902dc5a9 tempest-CreateVolumesFromSourceVolumeTest-1397897225 None] Lock "cinder-90cdad30-8ff0-4c1c-9959-0b7b73d11b78-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:34 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-85a85408-6108-4fb4-b17c-dd9a43176ad5" returned: 0 in 0.452s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-85a85408-6108-4fb4-b17c-dd9a43176ad5" released by "delete_volume" :: held 0.959s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:34 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Created reservations ['5e6be936-fbf7-4f20-b4ec-558d7f5bfb1f', '125a5006-b4ba-4aae-850c-1572cb20dc62', '65b3c579-31b7-4c35-8030-5e9cc6aaf55e', 'bad2c35e-aa89-44ab-9452-94e3a128bdf4'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:35 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:35 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-f554e168-7eee-4d2f-8fa6-692719e29a63-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-f554e168-7eee-4d2f-8fa6-692719e29a63-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" acquired by "delete_volume" :: waited 0.008s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[28499d1d-0c95-4388-ad1f-7a315d494452]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:35 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 Apr 08 17:46:35 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:35 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.511s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:35 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Deleted volume successfully. Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:UPDATE=268,cinder:SELECT=201,cinder:INSERT=71,cinder:DELETE=25 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-970560b3-eaf3-45c6-b9b2-502ae2e120e9 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-85a85408-6108-4fb4-b17c-dd9a43176ad5-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:35 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63" returned: 0 in 0.511s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:35 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63 Apr 08 17:46:35 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Flow 'volume_create_manager' (8b4560dd-2701-4414-b82a-2dc273073712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cd5a3f-8a93-42b8-8a3f-b26eb43d88a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cd5a3f-8a93-42b8-8a3f-b26eb43d88a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af00f76-dc9a-41a2-accb-3a8215a3d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ec6a45e4c840278449b2fe2e13ce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:36Z,use_quota=True,user_id='9b9ed6aee1f34115989a7f77f1db72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a6138-d0a4-4ef3-b85a-27c436457aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a6138-d0a4-4ef3-b85a-27c436457aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2a5b1-6b0c-4082-862b-c750f15a3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2a5b1-6b0c-4082-862b-c750f15a3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af00f76-dc9a-41a2-accb-3a8215a3d61c', 'volume_name': 'volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2efa66-7c4a-4439-9462-fa950c1dbffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2efa66-7c4a-4439-9462-fa950c1dbffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c129327-58fa-4b61-987a-0d34694cc3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:35 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Volume 3af00f76-dc9a-41a2-accb-3a8215a3d61c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c', 'volume_size': 1} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af00f76-dc9a-41a2-accb-3a8215a3d61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ec6a45e4c840278449b2fe2e13ce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:36Z,use_quota=True,user_id='9b9ed6aee1f34115989a7f77f1db72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Creating volume 3af00f76-dc9a-41a2-accb-3a8215a3d61c {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:35 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:35 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:35 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c 1073741824 Apr 08 17:46:35 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:36 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-f554e168-7eee-4d2f-8fa6-692719e29a63" returned: 0 in 0.433s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-quobyte-f554e168-7eee-4d2f-8fa6-692719e29a63" released by "delete_volume" :: held 0.970s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Created reservations ['e8ebed3e-9eff-430c-a914-fecc34dea371', 'c115d7c8-205c-4191-b230-a505125e607a', '4b844307-a030-4878-af46-cd2ededebf77', '3488c329-b5e6-4af3-9a15-21767eac3750'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:36 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:36 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:36 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c 1073741824" returned: 0 in 0.513s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:36 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c Apr 08 17:46:36 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:36 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.453s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Deleted volume successfully. Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-c5ba3ab5-e6f0-42fb-b786-68061ee64859 tempest-VolumeDependencyTests-659622227 None] Lock "cinder-f554e168-7eee-4d2f-8fa6-692719e29a63-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:36 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c" returned: 0 in 0.494s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c129327-58fa-4b61-987a-0d34694cc3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cbe903-8346-436b-bcea-95dec7ae2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:36 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Volume volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c (3af00f76-dc9a-41a2-accb-3a8215a3d61c): created successfully Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cbe903-8346-436b-bcea-95dec7ae2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:36 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Flow 'volume_create_manager' (8b4560dd-2701-4414-b82a-2dc273073712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:36 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-d1aeb622-4ab0-4117-b7fd-826d45fe6f6c tempest-CinderUnicodeTest-1210680428 None] Created volume successfully. Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Flow 'volume_create_manager' (4b0b1ddc-a726-4d52-8999-7c489a6b2a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4176415-5c8f-4fc3-baa2-46b494bdec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4176415-5c8f-4fc3-baa2-46b494bdec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276950185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f222d81-6a91-4f24-b27a-102ed08a7bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ec6a45e4c840278449b2fe2e13ce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:38Z,use_quota=True,user_id='9b9ed6aee1f34115989a7f77f1db72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8d92e5-9819-425d-9850-71576cdae892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8d92e5-9819-425d-9850-71576cdae892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64658c4-563f-4770-8cdd-518e5f000fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64658c4-563f-4770-8cdd-518e5f000fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f222d81-6a91-4f24-b27a-102ed08a7bfa', 'volume_name': 'volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be818efa-2804-4cdd-b9c6-c61492ff2e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be818efa-2804-4cdd-b9c6-c61492ff2e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d031768-2462-40f0-ace8-d376b93358b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:38 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Volume 4f222d81-6a91-4f24-b27a-102ed08a7bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa', 'volume_size': 1} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-08T15:46:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276950185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f222d81-6a91-4f24-b27a-102ed08a7bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ec6a45e4c840278449b2fe2e13ce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T15:46:38Z,use_quota=True,user_id='9b9ed6aee1f34115989a7f77f1db72f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d4500e-5561-4597-b502-02d6c06d0cf5),volume_type_id=b8d4500e-5561-4597-b502-02d6c06d0cf5)}" {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Creating volume 4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Selected osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f as target Quobyte volume. {{(pid=82664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 08 17:46:38 devstack cinder-volume[82664]: INFO cinder.volume.drivers.remotefs [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] casted to osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa 1073741824 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:38 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa 1073741824 Apr 08 17:46:38 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:38 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa 1073741824" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:38 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:38 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa Apr 08 17:46:38 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:39 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa" returned: 0 in 0.425s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'} {{(pid=82664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d031768-2462-40f0-ace8-d376b93358b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa', 'volume_size': 1}' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bae1a8-8c48-43c3-8a4d-4e53ccf09c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 08 17:46:39 devstack cinder-volume[82664]: INFO cinder.volume.flows.manager.create_volume [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Volume volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa (4f222d81-6a91-4f24-b27a-102ed08a7bfa): created successfully Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bae1a8-8c48-43c3-8a4d-4e53ccf09c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82664) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 08 17:46:39 devstack cinder-volume[82664]: DEBUG cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Flow 'volume_create_manager' (4b0b1ddc-a726-4d52-8999-7c489a6b2a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82664) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 08 17:46:39 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-2fe1694b-9ac6-40d4-b912-052304f42952 tempest-CinderUnicodeTest-1210680428 None] Created volume successfully. Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Creating offline snapshot 89601164-0704-4d59-930d-2f802ae1d214 of volume 4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ee8008-dcd2-4ea0-9cad-900a8d91ebaa]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:40 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa Apr 08 17:46:40 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:40 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa" returned: 0 in 0.499s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:40 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 1G {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:40 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 1G Apr 08 17:46:40 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:41 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 1G" returned: 0 in 0.466s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:41 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 Apr 08 17:46:41 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:41 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa -F qcow2 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214" returned: 0 in 0.424s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:41 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 is being set with open permissions: ugo+rw Apr 08 17:46:41 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:41 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 Apr 08 17:46:41 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:42 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214" returned: 0 in 0.413s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:42 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info Apr 08 17:46:42 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:42 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info" returned: 0 in 0.416s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:42 devstack cinder-volume[82664]: WARNING cinder.volume.drivers.remotefs [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info is being set with open permissions: ugo+rw Apr 08 17:46:42 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:42 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info Apr 08 17:46:42 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:43 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.info" returned: 0 in 0.409s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:43 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-9b03f0b1-5ec9-45a7-96f8-c41cf8546906 tempest-CinderUnicodeTest-1210680428 None] Create snapshot completed successfully Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-89601164-0704-4d59-930d-2f802ae1d214-delete_snapshot" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-89601164-0704-4d59-930d-2f802ae1d214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" by "delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-quobyte-89601164-0704-4d59-930d-2f802ae1d214" by "_delete_snapshot" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-89601164-0704-4d59-930d-2f802ae1d214" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Deleting offline snapshot 89601164-0704-4d59-930d-2f802ae1d214 of volume 4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] snapshot_file for this snap is: volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf3bc0-ed91-42a4-a701-8e2c9d165148]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:43 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:43 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 Apr 08 17:46:43 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:44 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214" returned: 0 in 0.470s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.remotefs [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad3ff60-07be-4793-abb4-37b68d85162f]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:44 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa Apr 08 17:46:44 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:44 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa" returned: 0 in 0.474s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:44 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:44 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 Apr 08 17:46:44 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:45 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214" returned: 0 in 0.451s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:45 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214 Apr 08 17:46:45 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:45 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa.89601164-0704-4d59-930d-2f802ae1d214" returned: 0 in 0.402s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-89601164-0704-4d59-930d-2f802ae1d214" released by "_delete_snapshot" :: held 1.871s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" released by "delete_snapshot" :: held 1.883s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Created reservations ['7f10a56c-8543-4ae4-9383-a5ce903597db', '590fab81-413c-4356-944d-d2bb454eb4d5', '19c3eb09-69cb-4785-9345-094581849cdb', '76d4f8f6-3b59-4c71-ab97-e056fd213b33'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:45 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Delete snapshot completed successfully. Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-a522a709-49b4-44f6-9bce-b34f2f073a93 tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-89601164-0704-4d59-930d-2f802ae1d214-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-4f222d81-6a91-4f24-b27a-102ed08a7bfa-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-4f222d81-6a91-4f24-b27a-102ed08a7bfa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdd32cc-ba51-4fc0-b7bf-cd1f191bffc3]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:45 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:45 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa Apr 08 17:46:45 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:46 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa" returned: 0 in 0.471s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:46 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa Apr 08 17:46:46 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:46 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-4f222d81-6a91-4f24-b27a-102ed08a7bfa" returned: 0 in 0.411s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-4f222d81-6a91-4f24-b27a-102ed08a7bfa" released by "delete_volume" :: held 0.910s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Created reservations ['68558e91-07df-4e1e-bd8a-72059f41cbda', '32e54429-dc08-455d-9d19-45b70877682c', 'f3f9652e-2ec0-4930-9825-de5118c1987d', '30853661-12bf-4426-b55e-138c34142b2d'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:46 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:46 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-3af00f76-dc9a-41a2-accb-3a8215a3d61c-delete_volume" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-3af00f76-dc9a-41a2-accb-3a8215a3d61c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "cinder-quobyte-3af00f76-dc9a-41a2-accb-3a8215a3d61c" by "delete_volume" {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-3af00f76-dc9a-41a2-accb-3a8215a3d61c" acquired by "delete_volume" :: waited 0.009s {{(pid=82664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f695902a-424b-4210-9d59-a6b3b5193dd9]: (4, 'qcow2') {{(pid=83435) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 08 17:46:46 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:46 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c Apr 08 17:46:46 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:47 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.440s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:47 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Deleted volume successfully. Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-34ae8086-a3d5-420a-a3bf-1ff38545a16d tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-4f222d81-6a91-4f24-b27a-102ed08a7bfa-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:47 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c" returned: 0 in 0.484s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:47 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c Apr 08 17:46:47 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:47 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147/volume-3af00f76-dc9a-41a2-accb-3a8215a3d61c" returned: 0 in 0.404s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-quobyte-3af00f76-dc9a-41a2-accb-3a8215a3d61c" released by "delete_volume" :: held 0.916s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.quota [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Created reservations ['1b0d4830-7247-4cb2-8b8c-a35744f48934', '3b0e3f21-2ecc-462b-8981-d1043e1d96dd', '248c34a2-0dce-45f4-aa2c-a4925895f844', '4a58076d-f0d1-4010-8789-773f762a78b2'] {{(pid=82664) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:46:47 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:46:47 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:46:47 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:46:48 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 08 17:46:48 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.419s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:46:48 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 08 17:46:48 devstack cinder-volume[82664]: INFO cinder.volume.manager [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Deleted volume successfully. Apr 08 17:46:48 devstack cinder-volume[82664]: DEBUG cinder.coordination [None req-16d1dacb-f3f9-44bb-a7ac-98efeeae208b tempest-CinderUnicodeTest-1210680428 None] Lock "cinder-3af00f76-dc9a-41a2-accb-3a8215a3d61c-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82664) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 08 17:46:57 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=24,cinder:INSERT=11,cinder:UPDATE=32,cinder:DELETE=4 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:46:58 devstack cinder-volume[82664]: DEBUG dbcounter [-] [82664] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=82664) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG oslo_service.periodic_task [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82664) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f': None} {{(pid=82664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4c6372e-6130-4cb6-9284-d975026d3a9f'] {{(pid=82664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.lockutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82664) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 08 17:47:02 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 08 17:47:02 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147 Apr 08 17:47:02 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 08 17:47:03 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 08 17:47:03 devstack cinder-volume[82664]: DEBUG oslo_concurrency.processutils [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3b0884c2ce597bc8f5a0d4ccc0f7147" returned: 0 in 0.426s {{(pid=82664) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 08 17:47:03 devstack cinder-volume[82664]: DEBUG cinder.manager [None req-0a9ef81a-f049-4217-a921-7ce50cb154c6 None None] Notifying Schedulers of capabilities ... {{(pid=82664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}